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PSYCHOMETRIC PATTERN OF SCHIZOPHRENICS ON 
THE WECHSLER-BELLEVUE INTELLIGENCE TEST 


By DORIS R. OLCH 


NORRISTOWN STATE HOSPITAL 
NORRISTOWN, PENNA. 


HE EARLY application of mental 

testing to the study of psychosis 
was primarily directed toward a deter- 
mination of the extent of so-called de- 
terioration caused by the disease process. 
A corollary to this problem was the in- 
vestigation of the relationship between 
intelligence level and type of psychosis. 
In the course of testing for deficit, it 
was noted that vocabulary was relatively 
well preserved in psychotics even when 
other abilities declined, and leading from 
this new interest, there developed an in- 
spection devoted to the broader relation- 
ship between verbal and nonverbal per- 
formance and psychosis. Finally, atten- 
tion became directed to psychometric 
pattern, which refers to the relation- 
ships among the various subtests of a 
single test or among the scores on a bat- 
tery of tests. Cameron [4], Hunt and 
Cofer [10], Brody [2, 3], and Rapa- 


1Taken from a Master’s thesis submitted to 
the University of Buffalo in partial fulfillment 
of the requirements for the degree of Master 
of Arts. The writer gratefully a 
her indebtedness to Dr. Olive P. Lester and Dr. 
Edward S. Jones, Professors of Psychology at 
the University of Buffalo, and to Dr. Lionel S. 
Penrose, former Director of Psychiatric Re- 
search of Ontario, Canada. 
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port [22] have adequately reviewed this 
literature pertaining to the use of men- 
tal tests with psychotic subjects. 

One of the purposes of test analysis 
in terms of psychometric pattern is to 
increase our understanding of the psy- 
chological processes involved in the psy- 
choses and to discover test patterns 
characteristic of the disorders, which 
may serve as a psychiatric aid in the di- 
agnosis and prognosis of cases. Investi- 
gations prior to 1939 [1, 5, 11, 14, 23] 
made intensive use of the Stanford-Bi- 
net Scale, but it became increasingly ob- 
vious that the construction of this test 
makes it an unwieldy instrument for 
pattern determination. The Wechsler- 
Bellevue Scale, published in 1939, has 
proved to be more favorably designed 
for pattern analysis since it is a point 
scale rather than an age scale, and is, 
moreover, standardized upon adults, 
thereby making available a large body of 
results from normal subjects of varying 
ages. 

Since the inception of the Wechsler- 
Bellevue Scale, numerous papers have 
been published which attempt to delin- 
eate characteristic test patterns for dif- 
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ferent nosological groups of mental dis- 
orders. A summary of the research con- 
ducted in this area has been presented 
by Rabin [21], and Watson [25] has re- 
cently extended this report. While indi- 
vidual investigations have succeeded in 
differentiating between normal and psy- 
chotic groups on the basis of psycho- 
metric pattern, a comparison of results 
shows there is not complete agreement 
in the patterns which have been report- 
ed, and therefore diagnosis of individual 
cases, using pattern of test performance 
as a cue, is not yet reliable. 

This study presents some additional 
data on the psychometric pattern of 
schizophrenic patients on the Wechsler- 
Bellevue Scale, and attempts to relate 
the results to the existing data on the 
problem. It appears to the writer that 
only by an accumulation of a large num- 
ber of studies, which corroborate one 
another in considerable measure, can we 
hope to establish a more precise and de- 
finitive picture of psychometric pattern 
for a particular psychosis. 


SUBJECTS AND TESTING PROCEDURE 


The subjects in this study, carried on 
during the year 1944-45, were 32 pa- 
tients of the Ontario Hospital, London, 
Canada, diagnosed as schizophrenic by 
the psychiatrists in attendance at the 
regular case conferences. Within the 
group of 32 schizophrenics were: 9 cata- 
tonics, 14 paranoids, 3 simple, 1 hebe- 
phrenic, 1 atypical, and 5 unclassified. 
The age range of the patients was 17 to 
49 with a mean age of 32.28 years. At 
the time of examination, 21 patients 
had been in the hospital less than 6 
months, 4 less than a year, 3 between 
four and nine years, and 2 cases were 
readmissions. 

The subjects were all English speak- 
ing. Their previous education ranged 
from 6th grade to college graduation, 
the mean educational] level being second 
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year high school. Full Scale IQ’s on the 
Weschler-Bellevue ranged from 69 to 
115, with a mean of 89.57, S.D. of 16.70. 

In regard to shock therapy, 9 subjects 
had received none at the time of the test, 
17 were being given or had completed a 
series of electric shocks, 3 had finished 
an insulin course and 1 was still under 
such treatment, 1 had received both in- 
sulin and electric shock and 1 both elec- 
tric shock and metrazol. In those cases 
still receiving the various shock treat- 
ments, a period of at least 24 hours was 
permitted to elapse from the time of the 
last treatment to the test.” 

The majority of patients were ac- 
quainted with the examiner who, in the 
course of her duties as assistant psy- 
chologist, had given them other psycho- 
logical tests at previous times. Rapport, 
therefore, was already established and 
a friendly attitude prevailed. Coopera- 
tion was at least fairly good, and many 
patients put forth real effort and ex- 
pressed an interest in the test. The re- 
sulting performance is considered rep- 
resentative of the patient’s ability at the 
time of the test, and differences noted 
from the normals should be indicative 
of psychotic pattern.’ 

The control groups used for compari- 
son with the test results of the psy- 
chotic patients are Wechsler’s standard- 
ization population. Wechsler supplies 
the means and S.D.’s on all tests of the 
scale for 345 subjects, aged 17-29, and 
345 subjects, aged 40-49. In addition to 
comparison with these normal controls, 

2A study conducted by the Research Depart- 
ment of the Ontario Department of Health in- 
vestigated the effects of insulin, metrazol and 
no shock therapy on psychometric pattern on 
the Stanford-Binet and reported no differential 
effects. It would seem likely that similar find- 


ings may be assumed for the Wechsler- Belle- 
vue Scale. [15] 

‘The criteria for representativeness used 
here are those listed by Roe and Shakow [23] 
and involved consideration of the following fac- 
tors: effort, interest, confidence, temporary psy- 
chotic episodes, emotional disturbances, physi- 
call illness and test conditions. 
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the results are compared with data ob- 
tained by Wechsler, Rabin, Magaret, 
Weider, and Rapaport on schizophrenic 
subjects. 

Directions given by Wechsler were 
followed throughout, except for a few 
necessary changes in the Information 
test to make the questions suitable for 
Canadian subjects. Listed below are 
these questions in their original and al- 
tered forms: 


Original Wechsler 
Who is the President of the U.S.? 
Who was President before him? 
How tall is the average American woman? 
What is the population of the U.S.? 
When is Washington’s birthday? 


Modifications 


Who is Prime Minister of Canada? 

Who was Prime Minister before him? 
How tall is the average Canadian woman? 
What is the population of Canada? 

When is Queen Victoria’s birthday? 


Tests were conducted individually by 
the writer. The administration of the 
test generally consumed 75 minutes and 
the scoring of each test was done sub- 
sequent to the examination period. All 
tests were completed in one session. 


DISCUSSION OF RESULTS 

Verbal—Performance Superiority 

Intelligence Quotients from the Wech- 
sler-Bellevue Intelligence test can be ob- 
tained not only for the full scale, but for 
the verbal half and the performance 
half, and are called, respectively, Verbal 
IQ and Performance IQ. The 1Q’s for 
the separate halves of the scale make al- 
lowance for age, just as does the full 
scale IQ. To determine which half of the 
Wechsier contributes most to total IQ 
for schizophrenics, a comparison be- 
tween mean Verbal IQ and mean Per- 
formance IQ is presented in Table I. The 
total group is separated into a younger 
age group, 17-29 years, and an older age 
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TABLE I 

VERBAL AND PERFORMANCE IQ DISCREPANCY 
Total Younger Older 
Group Group Group 
(17-29 (30-49 
yrs.) yrs.) 

Number of Cases ........ 32 16 16 
Mean Verbal 1Q.......... 90.12 89.50 91.05 
VS ce Paar . 20.85 19.30 12.05 
Mean Performance IQ 90.60 90.15 91.05 
S.D. . 21.35 17.05 15.75 
Mean Discrepancy .... —.48 —.65 .00 


group, 30-49 years, in order to see 
whether the picture is altered by age. 
Mean discrepancy is indicated by a plus 
sign to show the superiority of the Ver- 
bal Scale or a minus sign to designate 
superiority of the Performance Scale. 

Both the total group and younger 
schizophrenics show a slightly superior 
mean on the Performance Scale, but the 
Critical Ratio of the difference between 
Performance IQ and Verbal 1Q is only 
0.08 for the former group and 0.10 for 
the latter group and therefore does not 
satisfy the criterion for significance. 
There is no difference between Verbal 
and Performance means for the older 
schizophrenics. Thus, there is no sup- 
port here for the view that schizophren- 
ic patients do better on the Verbal part, 
as Wechsler [27] and Rabin [17] have 
reported; nor has a division of the total 
group into younger and older classifica- 
tions revealed any different trend as 
Weider [28] has shown. This lack of 
significant difference between Verbal 
and Performance IQ is, however, in 
agreement with the results of Magaret 
and Wright [13]. 


Comparison of Tests Scores and Pat- 
terns of Schizophrenics and Normals 
Table II lists the made by 
schizophrenics and normals on the vari- 
ous subtests of the Wechsler Scale, while 
Figure 1 graphically compares these test 


scores 
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TABLE II 


DISTRIBUTION OF MEANS, S.D.’s AND t’s FOR SCHIZOPHRENICS AND NORMALS 


“Younger Groups {17-29 yrs.) 


Older Groups (30-49 yrs.) 





Total Schiz. (32) Schiz. (N—-16) Normal (N-345) t Schiz. (N-16) Normal (N-345) t 
Subtests Mean S.D. Mean S.D. Mean S.D. Mean S.D. Mean S.D. 
Info. . 8.88 2.07 | 8.9 2.4 10.3 2.9 2.3 8.9 2.0 9.8 3.3 1.8 
Comp. ..... .. 7.08 2.42 7.3 2.3 10.2 3.0 4.8 6.8 2.4 9.7 3.3 4.8 
Arith. 1.25 887 | 7.3 3.0 9.4 2.9 2.6 1.3 5 9.1 3.4 2.0 
Dig. Sp. 8.22 3.24 | 8.1 3.1 9.8 3.0 2.1 8.4 3.2 8.7 3.0 4 
Simil. ...... 6.38 213 | 7.0 2.1 9.9 2.2 5.8 5.8 1.9 9.5 2.9 7.4 
Pic. Comp. .... 6.91 2.80 | 7.4 3.0 9.9 2.9 3.1 6.5 2.3 9.1 3.3 4.3 
Pic. Arr. 7.09 3.27 8.1 3.3 10.5 3.0 2.7 6.1 2. 8.5 3.3 3.4 
Obj. Ass. 9.47 3.32 10.5 3.1 10.2 3.0 4 8.4 3.3 9.1 3.3 8 
Bl. Des. ........ 8.91 2.7 10.0 2.9 10.7 2.9 1.0 7.8 2.2 8.9 3.3 1.8 
Dig. Sym. ........6.00 1.91 6.8 1.2 10.7 2.9 13.0 | 5.3 1.8 8.6 3.3 6.6 


patterns. One can see the shifts in pat- 
tern for both subjects and controls with 
increasing age and the differences be- 
tween them in the same age groups. The 
younger schizophrenics and normals are 
significantly differentiated by their per- 
formance on Comprehension, Similari- 
ties, Picture Completion and Digit Sym- 
bol since the disparity between scores 
would occur only in a fraction of 1 per 
cent of cases by chance, according to 
Fisher’s table of t. The lower ratings by 
the schizophrenics on the Picture Ar- 


rangement and Arithmetic subtests are 
also highly significant, and while the 
differences between subjects and nor- 
mals appear slight on Digit Span and 
Information, these differences are at 
the 5 per cent level of significance. The 
small differences in scores on the Object 
Assembly, and Block Design tests are 
not statistically significant. Between the 
older groups, the relative inferiority of 
the schizophrenics on the Digit Symbol, 
Picture Arrangement, Picture Comple- 
tion, Similarities and Comprehension 
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subtests is highly significant, since the 
differences are at the 1 per cent level of 
significance. On the remaining five sub- 
tests, a comparison of performance by 
schizophrenics and normals fails to yield 
statistically significant differences. 

Judging from the mean educational 
level of the schizophrenic subjects, one 
might infer that some deficit is obvious 
in their efficiency, but this is merely 
conjecture; there is no definite proof re- 
garding this point. But the fact that the 
psychotic group functions at a lower 
level of performance than the normals, 
whatever the cause, does not affect com- 
parisons in terms of which tests rate 
best, and which poorest within each of 
the groups. One method of comparison 
which eliminates any difficulties en- 
gendered by the discrepancies in specific 
scores is to convert all mean scores into 
rank orders. The subtest scoring high- 
est receives a rank of 1, that subtest 
scoring lowest gets a rank of 10, and 
accordingly for the other ranks. Table 
III presents a comparison of schizo- 
phrenics and normals in terms of such 
rank orders. 


TABLE III 


COMPARISON OF RANK ORDER OF SUBTEST 
MEANS FOR SCHIZOPHRENICS 
AND NORMALS 


~All Schizo- 17-29 Yrs. 30-49 Yrs. 
phrenies Schiz. Normals Schiz. Normals 











Subtests (N-32) (N-16) (N-345) (N-16) (N-345) 
a wena 3 3 4 1 1 
Comp 7 7.5 5.5 6 2 
Arith ‘ 5 7.5 10 5 5 
8 4 4.5 - 2.5 iy 
Simil. 9 q 7.5 9 3 
Pic. Comp. ... 8 6 7.5 7 5 
Pic. Arr. ....... 6 4.5 3 8 10 
Obj. Ass. . ‘ 1 1 5.5 2.5 5 
ae 2 2 1.5 4 7 
Dig. Sym. ...... 10 10 1.5 10 9 





From Table III it is evident that the 
Digit Symbol test distinguishes most 
clearly between the psychometric pat- 
terns of younger schizophrenics and 
younger normals: for the former this is 


their poorest test, for the latter, one of 
their best. Distinct differences between 
the two groups are also obvious in the 
rank orders assigned Object Assembly 
and Digit Span, while the other tests 
fail to show major disagreement. The 
older schizophrenics and normals differ 
in their placement on Comprehension, 
Similarities and Digit Span and are 
fairly alike on the others. 

The Digit Symbol test, which involves 
the formation of new associations with- 
in a very short time, offers a most inter- 
esting picture. Normals decline sharply 
in such ability with advancing age, while 
the schizophrenics consistently rate 
lowest. This would suggest that we are 
dealing with an ability which becomes 
severely impaired by both the schizo- 
phrenic process and normal advancing 
age. Comprehension and Similarities 
assume high ranks as the normal group 
moves from the younger to the older 
range, but for schizophrenics, the two 
tests persist at a low level. Apparently 
the social judgment involved in the 
Comprehension test and the ability to 
ignore superficial differences and attend 
to essential but more abstract likenes- 
ses required by Similarities are func- 
tions which are affected by schizo- 
phrenia so that the normal increased 
proficiency with older age does not oc- 
cur. Object Assembly and Digit Span 
are maintained at approximately simi- 
lar relative positions between psychotic 
and nonpsychotic groups. 


Comparison of Schizophrenic Patterns 
as determined by Various Investigators 


The method of assigning rank order 
to mean scores of the subtests makes it 
possible to compare the results obtained 
in this study with those reported by 
other investigators who tested schizo- 
phrenic patients with the Wechsler- 
Bellevue Scale. Table IV sets up a com- 
parison of findings for younger and old- 
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TABLE IV 
COMPARISON OF RANK ORDER OF SUBTEST MEANS | FROM VARIOUS INVESTIGATIONS 
Younger Groups "Older Groups 

Rabin Weider Olch Magaret Weider Oleh Rapaport 
Subtests 18-25 yrs. 16-28 yrs. 17-29yrs. 30-40yrs. 31-49yrs. 30-40yrs. 25-55 yrs. 

_N-19 _N-20 N-16 N-30 N-30_ N-16 N-7 
Er 1 3 3 1 3 1 2 
EE 2 1 7.6 6 1.5 6 6 
) TTT 3 7 7.5 8.5 8 5 7 
| 8 4 4.5 5 5.5 2.5 5 
Se 7 2 9 4 1.5 9 3.5 
, se 6 8 6 7 5.5 7 9 
, | are 4 5 4.5 8.5 9 & 10 
Obj. Ass 10 9 1 2 7 2.5 1 
EE 5 6 2 3 4 4 3.5 
Ee 9 10 10 10 10 10 8 


er age groups. The investigator, age 
range of patients and number of cases 
are noted for each study.‘ 

This study agrees with both Rabin 
and Weider in finding a superiority of 
the younger schizophrenics on the In- 
formation, average ability on Picture 
Arrangement and Picture Completion, 
and inferior performance on Digit Sym- 
bol. There is confirmation of Rabin’s 
low ranking for Similarities, but agree- 
ment with Weider on Arithmetic and 
Digit Span. This study, however, finds 
relatively poor Comprehension, while 
Rabin and Weider rate this highest and 
second highest, respectively, and finds 
relatively good performance on Object 
Assembly and Block Design, on which 
tests Rabin and Weider report poor 
ability. The last three mentioned differ- 
ences are in agreement with Magaret’s 
findings which are based on slightly old- 
er subjects, and with Rapaport’s results. 

4Rank orders listed under Rapaport’s name 
are obtained from the mean scores of the de- 
teriorated, unclassified schizophrenic group, 
since Rapaport has stated that their test pat- 
tern is representative, in exaggerated form, of 
the general schizophrenic performance on the 
Wechsler-Bellevue Scale. The method of arriv- 
ing at these results differs somewhat from the 
other studies since there was no attempt to 
control age and classification of the patient 
was determined on grounds other than origi- 
nal diagnosis. Nevertheless, some comparison 


between Rapaport’s findings and the others’ 
may be made. 


The writer finds it difficult to under- 
stand and reconcile these divergent find- 
ings. Most studies with the Binet have 
consistently pointed to poor perform- 
ance on questions involving practical 
judgment, such as the Comprehension 
test demands [10, 14, 23], so that the 
report of Magaret, Rapaport and this 
study are further evidence on this point, 
whereas Rabin’s and Weider’s reports 
are contrary to the usual results. Rabin’s 
study on retests of schizophrenics [20] 
reveals an extremely low correlation be- 
tween initial and subsequent standing 
on Comprehension, and it may be that 
the divergencies among reports by dif- 
ferent investigators merely reflect the 
marked fluctuations characteristic of 
schizophrenics on this particular test. 
The relative superiority on Object As- 
sembly and Block Design noted in this 
work and that by Magaret and Rapaport 
in contradistinction to the inferior ranks 
assigned by Weider and Rabin cannot 
be explained by the writer. 

Turning attention to the older schizo- 
phrenics, there is unanimity of agree- 
ment of superiority on Information and 
Block Design and inferiority on Picture 
Arrangement and Digit Symbol. Fur- 
thermore, there is perfect consistency 
with the report of Magaret that schizo- 
phrenics do very well on Objeet Assem- 
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bly and poorly on Picture Completion 
and Comprehension. Slightly better per- 
formance upon Arithmetic and Digit 
Span and less ability on Similarities are 
recorded for the schizophrenics of this 
study than by either Magaret, Weider 
or Rapaport. 

The differences in ranking in Arith- 
metic and Digit Span are comparatively 
unimportant. Similarities, however, dif- 
fers sharply, but the writer’s data agree 
in this instance with Rabin’s report on 
the younger group and with Wechsler’s 
clinical impressions [27]. Since success 
on Similarities involves the ability to 
disregard easily apparent differences 
and infer less obvious generalizations, 
analogous to the requirements of the 
sorting tests used by Vigotsky [24], 
Goldstein [7], and Hanfmann and Ka- 
sanin [8], the relatively poor perform- 
ance of schizophrenics on this test is in 
keeping with the results noted on the 
sorting tests by the above investigators. 


Variability or Scatter in Schizophrenic 
Performance 


By obtaining the arithmetic sum of 
the mean deviation scores for each of 
the two schizophrenic and normal 
groups, some measure of the overall 
variability of their performance may be 
noted. When this is done, the following 
results: 


Younger Schizophrenics .............. 9.8 
Older Schizophrenics .................... 10.3 
Younger Normals ........................ 3.2 
I 3.4 


Thus the variability of the schizo- 
phrenics is greater than that of the 
normals. This conclusion of greater in- 
tertest variability for schizophrenics is 
in harmony with Magaret [12], Wech- 
sler [27], and Rabin [17], and offers 
additional disagreement with Gilliland 
et al. [6]. 
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Schizophrenia as a Premature Aging 
Process 


The hypothesis that schizophrenia re- 
sembles “premature aging”, proposed by 
Magaret [12] and refuted by Rabin [19] 
is examined here on the basis of the per- 
formance of the schizophrenics in this 
study. Table V indicates those tests 
which “hold up” and “do not hold up” 


TABLE V 


TESTs WHICH “HoLp UP” AND “Do Not HOLpb 
Up” In SCHIZOPHRENICS AND OLD AGE 


Schizophrenics 





Norma! Old Age Normal Old Age 
(Olch) (Wechsler) (Rabin) 
Hold Up Obj. Ass. Info. Info 
Bl. Des. Comp. Comp 
Info. Obj. Ass imil. 
Dig. Sp. Pic. Comp. Dig. Sp. 
Arith. 
Do Not Dig. Sym. Dig. Sp Dig. Sym 
Hold Up Simil. Arith, Pic. Arr. 
Pic. Com, Dig. Sym. Bl. Des 
Comp. Bl. Des. Pic. Comp 
Pic. Arr Simil. 
(Pic. Arr.) 


for the total group of schizophrenics 
and for old age in normals as given by 
Wechsler [27] and Rabin [19]. 
Comparing Wechsler’s arrangement 
for old age with that of schizophrenics, 
there is agreement in placement of Ob- 
ject Assembly, Information, Digit Sym- 
bol, Similarities and Picture Arrange- 
ment. The other tests are assigned op- 
posite categories. With Rabin’s old age 
group, the schizophrenics show similar- 
ity on Information, Digit Span, Digit 
Symbol, Picture Arrangement, and Pic- 
ture Completion. Thus, there is a re- 
semblance in trend for schizophrenia 
and old age in normals on about half the 
tests, and no similarity for the others. 
Another means of testing this con- 
ception of “premature aging” in schizo- 
phrenia is to compare the mean devia- 
tions from the mean scores of schizo- 
phrenics and older age normals for evi- 
dence of similarity in direction of 
change. This method was first used by 
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Magaret [12] and later adopted by 
Rabin [19]. Table VI represents the 
mean deviation scores for the younger 
schizophrenics of this study, the older 
normals of Wechsler’s standardization 


TABLE VI 
COMPARISON OF MEAN DEVIATION SCORES OF 
YOUNG SCHIZOPHRENICS AND 
OLDER NORMALS 


Normals Normals Schizophrenics 
Subtests 30-49 yrs. 60-84 yrs. 17-29 yrs. 
(Weschler) (Rabin) (Olch) 

Info. 0.7 2.8 0.8* 
Comp. 0.6 2.4 —0.8 
Arith. 0.0 0.1 —0.8 
Dig. Sp. —0.4 0.4 0.0* 
Simil. 0.4 0.6 -1.1 
Pic. Comp. 0.0 —0.6 —0.7* 
Pic. Arr. -0.6 —2.4 0.0 
Obj. Ass. 0.0 -—0.4 2.4 
Bl. Des. —0.2 —0.6 1.9 
Dig. Sym. -0.5 2.6 —1.3* 

* Parallel change between schizophrenia and normal 


aging. 


population, and the mean deviations re- 
ported by Rabin [19] for an aged group 
of normals ranging from 60-84 years. 
If Magaret’s hypothesis is correct, then 
deviation scores of the schizophrenics 
should tend in the same direction demon- 
strated by normals with advancing age. 

Only the four starred tests disclose a 
parallel change between schizophrenia 
and the normal aging process. One is 
forced to conclude, therefore, that the 
schizophrenics tested in this investiga- 
tion resemble the picture characteristic 
for old age on some of the tests, but not 
all. Rabin’s comment [19] that the simi- 
larity is “not better than chance” is con- 
firmed if one considers only the number 
of tests showing corresponding changes 
between schizophrenia and the normal 
aging process; but it is more than 
“chance” that all three studies (Rabin, 
Magaret and Olch) should indicate the 
same trends on the Picture Completion, 
Information, and Digit Symbol and 
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partially agree on Picture Arrangement 
and Digit Span. While Rabin’s psycho- 
metric data on an older group of nor- 
mals furnishes proof that the timed per- 
formance tests decline concurrently with 
age, whereas some factor or factors 
other than time is operative in schizo- 
phrenia, the hypothesis that the schizo- 
phrenic process may bear some resem- 
blance to advancing age is not disproved, 
and deserves further examination. 


SUMMARY 


Thirty-two schizophrenic patients at 
the Ontario Hospital, London, Canada, 
were tested on the Wechsler- Bellevue 
Intelligence Scale during 1944-1945 and 
their psychometric performance ana- 
lyzed. Many factors such as the small- 
ness of sample, inclusion of all types of 
schizophrenia in a single category, and 
a wide age, educational and IQ range 
for subjects, limit somewhat the signifi- 
cance of the statistical results in terms 
of conclusions. Nevertheless, the results 
do add material to the several studies 
that have been carried on in the field of 
psychometric pattern and schizophrenia. 
Within the boundaries of this study, the 
following results were found: 

1. There is no significant statistical 
difference between the IQ’s of schizo- 
phrenic subjects on the Performance 
and Verbal Scales of the Wechsler-Belle- 
vue Scale. 

2. Highly significant differences be- 
tween younger schizophrenics and nor- 
mals were obtained on test scores for 
the Digit Symbol, Comprehension, Simi- 
larities and Picture Completion tests. 
Between the older groups, differences in 
scores on these four tests plus the Pic- 
ture Arrangement were found to be sta- 
tistically significant. 

3. The psychometric pattern for 
young schizophrenics is as follows (tests 
listed in order of relative difficulty, 
starting with the easiest and progress- 
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ing to the hardest): Object Assembly, 
Block Design, Information, Digit Span, 
Picture Arrangement, Picture Comple- 
tion, Arithmetic, Comprehension, Simi- 
larities, and Digit Symbol. 

The psychometric pattern for older 
schizophrenics is: Information, Digit 
Span, Object Assembly, Block Design, 
Arithmetic, Comprehension, Picture 
Completion, Picture Arrangement, Simi- 
larities, and Digit Symbol. 


4. The schizophrenic pattern obtained 
is compared with results reported by 
Magaret, Weider, Rabin, Rapaport, and 
Wechsler. 


5. Variability in test performance is 
considerably greater for the schizo- 
phrenics of this study than for Wech- 
sler’s normal groups. 

6. The schizophrenic process and nor- 
mal advancing age produce similar ef- 
fects on approximately half the subtests 
of the Wechsler-Bellevue Scale. 
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THE CLIENT EVALUATES NONDIRECTIVE 
PSYCHOTHERAPY* 


By STANLEY LIPKIN 


VETERANS ADMINISTRATION, CHICAGO, ILLINOIS 


N THE past several years, the body 

of evidence testifying to the effect- 
iveness of nondirective or client-cen- 
tered psychotherapy has been growing 
steadily. Not only are there favorable 
reports by those who have used the non- 
directive approach, but there is, in ad- 
dition, a stockpile of verbatim record- 
ings which makes it possible for other 
students of human behavior, irrespec- 
tive of discipline or therapeutic bias, to 
evaluate independently the results of the 
treatment process. 

However, while the nondirective ther- 
apists have striven toward a fuller un- 
derstanding of what takes place during 
counseling and have worked toward the 
establishment of objective criteria with 
which to measure the changes that take 
place in the client during the process, 
as well as as a result of it, no attempt 
has been made to determine how the 
client sees the process and how he evalu- 
ates its efficacy. True, it has been noted 
that clients often comment on the fac- 
tors in the technique which they con- 
sider responsible for their reaching a 
more complete understanding of them- 
selves and their difficulties. But no sys- 
tematic attempt has been made to date 
in the direction of getting the client’s 
view and evaluation of the counseling 
process. 

Believing that there is definite value 

iThe author is indebted to Dr. Carl R. Rogers 
for his help in planning and carrying through 
the project on which this article is based, for 


his criticism of the manuscript and for his 
writing the summarizing discussion. 
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to be derived from seeing the counseling 
process as it appears to the client, the 
writer undertook the following explora- 
tory study. Upon completion of a 
case, the client, whether he seemed sat- 
isfied or otherwise, was asked several 
questions designed to reveal what he 
thought had transpired during the coun- 
seling process, what changes, if any, had 
taken place in him and his situation as 
a result of it, and how satisfied or dis- 
satisfied he was with it. 

After experimenting with various 
types of questions, it was decided that 
the most productive manner of getting 
at such information would be to ask 
three general questions, thereby per- 
mitting each client to formulate his re- 
sponses in his own way. What the writ- 
er, who was also the counselor, would 
say to the client was, in essence, “Joe, 
we’re interested in improving the serv- 
ice that we offer. With a view to im- 
proving it, we’re asking all our clients 
to answer some questions for us. We be- 
lieve that if these questions are an- 
swered honestly and critically, we'll 
learn how to be of better service to the 
men who come in. Here’s a pencil and 
some paper. Give me, in your own 
words, 1) What seemed to be the story 
before you came in, 2) What seemed to 
go on during your visits here, and 3) 
How things look to you now. Please be 
as critical and as frank as you can.” 

Often, a client would ask the counse- 
lor to specify more precisely just what 
was wanted. At such times, the counse- 
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lor would make it clear that the client 
was to respond in any way that he saw 
fit. This intentional vagueness made it 
possible for each client to be unique in 
his answers and to reveal, through his 
remarks, what in the experience seemed 
most pertinent and had most meaning 
for him. The value of this is self-evident. 
For, if there were marked differences in 
the responses or if they fell into a pat- 
tern, there would be some indication as 
to whether or not the nondirective ap- 
proach offers to the client what its prac- 
titioners believe it does, whether the 
client takes out of the experience ele- 
ments which had previously not been 
considered or whether it fails to meet 
his needs completely. 

There are no doubt many objections 
to a procedure of this kind. Perhaps 
humorously, one may say that it is tan- 
tamount to requesting testimonials. Or, 
that the client cannot help but be influ- 
enced by the fact that it is for the coun- 
selor, with whom he has recently been 
or perhaps still is emotionally involved, 
that he is writing his evaluation. But 
this does not seem to happen as inspec- 
tion of the excerpts cited will reveal. In- 
stead, the absence of moral judgement 
from the entire counseling process seems 
to so free the client that he can be criti- 
cal of the counselor and he can readily 
express dissatisfaction with any phase 
of the process, when such dissatisfaction 
is present. 

Another objection that may be raised 
is that the evaluation is too subjective 
and therefore not entirely valid. How- 
ever, since the client comes to the coun- 
selor of his own volition because he rec- 
ognizes that he needs the assistance of 
an external agent in working through 
his problems, why should it not logically 
follow then that he can be trusted to 
know when he no longer needs that as- 
sistance and whether the treatment 
made available te him was helpful or 
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otherwise ? 

Needless to say, it would enhance the 
validity of the client’s document if sup- 
porting evidence (such as might be pro- 
vided by outside observers) were avail- 
able. But such not being the case, re- 
liance can still be placed on other meas- 
ures, such as the internal consistency of 
the document, the clinical judgement of 
the counselor, etc., to ascertain that the 
client is not only not deceiving the coun- 
selor, but that he is also not deceiving 
himself. 

It was recognized that another means 
of insuring honesty in the evaluations 
would be to guarantee complete ano- 
nymity to the client, such as would be 
the case if he could send in his evalua- 
tion unsigned. However, in this instance, 
the writer deliberately chose to have 
the client set forth his evaluation in the 
office, immediately after treatment was 
terminated, since it was believed that 
by so doing, the statements of all clients 
would be available rather than only 
those of an unrepresentative sample 
who would go to the trouble of writing 
and sending theirs in on their own. How- 
ever, once in a while, a client did ask to 
be permitted to write his evaluation at 
home, where he could give it more 
thought and consideration. Since the 
statements of these clients seemed to 
differ in no wise from those of the cli- 
ents who had written theirs in the of- 
fice, their statements have been includ- 
ed here also. 

Another shortcoming frequently at- 
tributed to personal documents is that 
those who write them do not always 
have the same command of language so 
that comparisons and generalizations 
cannot be made. Nevertheless, in spite 
of the differences in fluency with the 
written word and the wide range of 
I.Q.’s of the group under consideration 
here, the documents reveal that each cli- 
ent did manage to express the meaning 
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that the experience had for him and that 
the comments were frequently essential- 
ly the same, although the manner of ex- 
pression differed. 

The following material is based on the 
reports of 37 clients, all of whom were 
counseled nondirectively. The clients 
were all veterans who had been referred 
to the counselor by a Veterans Admini- 
stration training officer or vocational 
adviser. The number of hourly inter- 
views per client varied from two to ten, 
the median number of interviews per 
client being approximately 4.5. The 
problems ranged from simple vocational 
indecision to severe anxiety states. 

The documents are of varying lengths, 
the shortest being half a page long and 
the longest, twenty-five handwritten 
pages. This latter was one of those that 
had been written at home. For the most 
part, the clients wrote approximately 
two pages. 

This material will be presented in ex- 
cerpt form to point up the process as- 
pects of the counseling situation, as they 
appeared to the clients. In order to pre- 
sent the full flavor of the material which 
has been analyzed, some documents will 
be included in their entirety. The lang- 
uage in all quotations is that of the cli- 
ent. No attempt has been made to change 
either the language, spelling or punctua- 
tion. 


PHILOSOPHY OF NONDIRECTIVE THERAPY 


Nondirective therapy has as its two 
principal techniques simple acceptance 
and meaningful, sensitive reflection of 
emotionally charged attitudes expressed 
by the client. The use of other techniques 
(and this is what differentiates the non- 
directive approach from others), such 
as interpretation, suggestion, reasoning, 
persuasion, probing, passing judgement, 
etc., is not advocated. For, as has been 
made so explicit in the literature on the 
subject, the underlying philosophy of 
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nondirective psychotherapy is based on 
the concept that the individual has with- 
in himself strong growth drives which 
he can best be helped to realize if the 
counselor does not take over major re- 
sponsibility for the treatment process 
by acting as a direct omniscient influ- 
ence, but if, instead, he serves the client 
as a catalytic agent, by enabling him to 
utilize his own resources for resolving 
his conflicts. 

From the standpoint of the counselor, 
this involves his making it evident to 
the client, by his behavior and attitude, 
that he respects him as an individual, 
that he is not there to sit in judgement 
on his patterns of behavior or his mo- 
tives, that he believes in his resources 
for self-realization and that it is his 
(the counselor’s) purpose to help him, 
not by debilitating those resources, but 
rather by strengthening them by pro- 
viding a milieu in which he, the client, 
can reach a fuller understanding of him- 
self and choose his course of action in a 
constructive manner. 

From the standpoint of the client, this 
would mean that the interviews are not 
planned or structured for him by the 
counselor nor are any tailor-made solu- 
tions to his problems going to be handed 
to him. Instead, it will be he, the client, 
who will select the subject to be dis- 
cussed ; it will be left to him to probe in- 
to his own behavior and attitudes as 
deeply or as superficially as he sees fit; 
it will be the client who will decide how 
the time allotted for him is to be used; 
and all decisions arrived at during the 
course of the counseling process will 
have to be of his own making. 


THE CLIENT’S CONCEPT OF THE 
COUNSELING PROCESS 


While many of the clients under dis- 
cussion here did not go into the dynam- 
ics of the counseling process as thor- 
oughly as we should have liked for the 
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purposes of this study, at least one-third 
made comments indicating their con- 
scious awareness of what had taken 
place during the process or their under- 
standing of why the counselor conducted 
himself as he did, as well as how the 
role he played helped them in the reso- 
lution of their difficulties. Some ex- 
cerpts, characteristic of this group, fol- 
low. 


Client No. 2:2 “The counsellor was trying to 
make me think everything out for myself. At 
times his silence would anger me, but at the 
same time I felt he must have a purpose. 

Because of his silence of not answering or 
giving opinions, I had to delve in my own mind 
deeper and deeper. In other words, the ans- 
wers were my own completely & for this rea- 
son have stuck with me.” [Italics indicate cli- 
ent’s underscoring. ] 

Client No. 6: “The method of his that was 
employed, I think is very good. It is: the client 
explains his situation, and by stating that situ- 
ation he gets a general knowledge of the prob 
lem to a greater degree and then by going step 
by step with the counselor he goes even deeper 
into the situation and finally gets to the core 
of the problem, and it is solved.” 


Client No. 10: “Through having to put my 
concerns into words and logical sentences, 
which was necessary as I couldn’t keep silent 
longer than the counselor, I began to under- 
stand them better and saw them in different 
lights. Some of my vague thoughts were put 
into words by the counselor so that I had a 
fuller understanding of the three things I was 
concerned over. After I told him of my prob- 
lems and he didn’t suggest any solutions which 
was what I had expected from counseling, I 
found again that silence could be embarrassing 
and found it necessary to make up some meth- 
ods of overcoming my difficulties which later, 
after being re-phrased by the counselor, began 
to make sense.” 

Client No. 13: “During these talks I was the 
aggressor. He listened; I was taken back by 
this method at first, but feel now that it has 
wonderful advantages. I told of experiences 
which proved my theory for my feeling. One 
experience brought up another, until I told 


2The clients are numbered in accordance 
with the sequence of the receipt of their docu- 
ments. Hence, client No. 2 is the second client 
to have written an evaluation, client No. 6 is 
the sixth, etc. 
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nearly everything that I thought might help. I 
found myself telling things that I had never 
previously thought of. Mr. L. would rearrange 
my statement into questions & hence give me 
more to think about.” 

Client No. 30: “During the interviews my 
psycologist took my views & thoughts and 
made them so that I could understand what 
was going on. He didn’t conclude them but 
stated them back to me so I could draw my own 
conclusions. Things we talked about seemed 
clearer in my mind & organized it to an ex- 
tent where now I belive I can think things out 
for myself.” 

Client No. 33: “At first I wondered why I 
had to do all the talking but as it went on I 
could see that it had the effect of making me 
dig deep inside of me and bring up things that 
I hardly knew were troubling me. I know that 
practically every time I’d start off hardly 
knowing what to talk on but as time pro- 
gressed I talked much more freely.” 


It would seem that the excerpts cited 
above substantiate the validity of many 
of the basic tenets of nondirective thera- 
py. That is to say, the client seems to 
react to the permissiveness of the atmos- 
phere and to the counselor’s nondirec- 
tiveness by doing precisely what the 
counselor expects him to do—namely, be- 
come more introspective, more self- 
searching, more capable of looking into 
those areas which he had previously 
been unwilling or unable to examine and 
more resourceful in resolving his diffi- 
culties. 

But, as is apparent from the excerpts 
cited, more than this happens. First, al- 
though the clients seemed to be in gene- 
ral agreement that the nondirective pro- 
cess made it possible for them to explore 
quite independently the motives for 
their attitudes and behavior, thereby 
achieving insight and resolving their 
conflicts, there was no uniformity of 
initial reaction to the counselor’s “si- 
lence” and “lack of aggressiveness”. 

Thus, despite the fact that none of the 
37 clients who wrote their evaluations 
were specifically directed to this aspect 
of the counseling technique, 14 of them 
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found it meaningful enough to warrant 
commenting upon. The nature and range 
of reactions described was wide and 
varied. As has already been seen, client 
No. 2 found that it made her angry. 
Client No. 10 found the counselor’s “si- 
lence” “embarrassing”. Client No. 3 
said, “‘At first I tried to figure out what 
he wanted me to say or do. I was try- 
ing to outguess him or more to diagnose 
my case as I thought he would. That 
didn’t pan out. I did all the talking.” 
Client No. 3 was only one of four who 
expressed their surprise at having to do 
what they considered “all the talking’. 
The others stated frankly that they were 
pleasantly surprised to find that they 
were to have the “floor to themselves” 
and that they would be permitted to 
“talk themselves dry’. Of the eight re- 
maining clients who commented on this 
aspect of the counseling technique, two 
were “amused”, three were “taken 
aback”, two doubted if it could be of 
help and the last reported his reaction 
in the following manner: “I was lost in 
your presence, especially when I was 
told that I had an hour with you. I could 
either sit or talk or do as I pleased. The 
impression I received was of being left 
alone, all on my own with my problem.” 
It would seem that the client who 
found the silence of pauses embarras- 
sing, reacted to the silence as if it were 
a bludgeoning force compelling him to 
go on. However, whether these clients, 
at the start, found the nondirective ap- 
proach amusing, provoking, embarras- 
sing, surprising or insufficiently sup- 
portive, each of them was able to accept 
the challenge of assuming major re- 
sponsibility for his own treatment, and 
each reported gratifying results. Typi- 
cal of the final comments of these cli- 
ents is the one made by the client who 
had at first felt that he was “alone” 
with his problem. His statement reads 
as follows: “But I soon discovered that 
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by talking of my indecision and problem 
I was able to see clearly that my pro- 
blem was being solved of my own ini- 
tiative rather than the counseling of my 
interviewer.” 

The second important point that is 
apparent from the excerpts cited above 
relative to process is that many clients 
have definite feelings about selecting 
their own course and arriving at their 
own decisions. Thus, 12 stated that they 
had received a considerable measure of 
gratification from the discovery that 
they could think their own problems 
through and chart their courses on their 
own, 3 stated that they would have liked 
to receive more concrete advice, and the 
remaining 22 made no mention of this 
point. 

It is to be regretted that only a few 
of the statements of the 12 who found 
arriving at their own decisions gratify- 
ing can be included here since they pro- 
vide evidence for two of the basic con- 
tentions of nondirective therapy: (a) 
that to deprive the client of his right to 
self-determination is to rob him of his 
democratic right to mould and shape his 
life as he sees fit, and (b) that to de- 
prive him of that right is to stunt him 
in his growth. Further, as has been in- 
dicated by client No. 2, permitting the 
client to arrive at his own solutions 
means that the likelihood that he will 
abide by them is greater than would be 
the case if they were not his own. The 
excerpts which follow indicate that the 
clients themselves frequently recognized 
the significance of these contentions. 


Client No. 20: “It seems that once in a while 
during a man’s life, a little sound advice is 
necessary. A person can get advice too often 
and most of the time it is not appreciated. 

There are different types of advice and dif- 
ferent ways of giving it. 

I think that within the last two weeks I have 
gotten the best type. 

It seemed to have been the silent type. Let- 
ting my mind arrive at its own conclusion. 
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A good listener is always available, but the 
one that can listen and also add the right word 
or idea occasionally is a little harder to find. 

Thanks for your type of good sound advice.” 


Client No. 5, who had anticipated 
what he called a “Mr. Anthony” type of 
interview or one that “might revolve 
around a psycho-analysis basis,” said: 


I know that this counselling has benefited me 
in that it has helped me to make certain de- 
cisions for my future and exactly how I will 
go about building to reach my objective. I 
realize now how important it is for a person 
to arrive at his own decisions rather than rely 
on someone else for “advice” and it will be up 
to me to pick out my objective in the near fu- 
ture and work toward a definite goal. 


As for those clients who recognized 
that what they had learned during the 
counseling process had implications for 
their future ability to think through 
any problems that might arise, three 
had the following to say: 


Client No. 10: “When attempting anything, 
it should be given the best that you have, ap- 
proached with and carried through with the 
idea that you can do it if anybody can, and 
in either case of success or failure, the respec- 
tive reasons for each should be analyzed and 
mentally filed for use in similar problems.” 
[Italics indicate client’s underscoring. ] 

Client No. 12: “Now that I have completed 
councling I have a secure feeling and I see 
clearly the things that were confusing me be- 
fore. I find that with a little effort on my part 
that I am capable of taking a problem and 
clearify it, and them figure it out, thus com- 
ing to a proper conclusion.” 

Client No. 21: “I mentioned the things that 
were on my mind and the more I talked about 
them the easier they seem to be. the timely re- 
marks the counselor made made the things 
clearer to me. In that manner I learned to 
understand my problem. ..... I feel I will be 
able to handle anything that might come up 
in the future.” 


It should be noted that two of the 
twelve clients who talked of resolving 
their difficulties on their own specified 
that they had reached their decisions 
during intervals between interviews. 

To some, the counseling process, as 
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reported in their documents, was an ex- 
ceedingly painful experience. For fre- 
quently, in exploring the source of their 
difficulties, the clients uncovered truths 
about themselves which were none too 
pleasant to acknowledge and which they 
felt they had to face squarely in the 
counseling situation. 

It is exceedingly interesting that, at 
the conclusion of counseling, these cli- 
ents were able to describe these feelings 
and to discuss what they consider the 
defects and lacks in their personalities 
which they painfully came to recognize 
during the course of the counseling pro- 
cess. Perhaps their ability to discuss 
these “defects” on a more or less object- 
ive level can be attributed to the fact 
that they have learned to accept them- 
selves as they are. In fact, one client, 
No. 9, sees himself so objectively that 
he discusses himself in the third person. 


Client No. 2: “After each meeting, I would 
leave the building asking myself many ques- 
tions, and at first counselling made me more 
unhappy than I was originally. But this was 
only because the realization of many factors 
became clearer to me, & I had to become ad- 
justed to my new way of thinking.” 

Client No. 3: “I returned to my apartment 
somewhat nervous and excited, and as usual I 
felt pretty much misunderstood. Then I got 
to thinking that maybe there wasn’t so much 
difference in what had happened to me and 
that which had happened to plenty of other 
people. 

The difference was with me. They had guts 
enough to snap out of it, whereas I expected 
busy people to take time to sit around and 
comiserate with me.” 

Client No. 9: “During counselling, he was 
forced, in his own mind to admit that several 
of these things were wrong. He began to think 
and actually admit things to himself about 
himself that he had never considered admitting 
before. He began to see just what was at the 
root of all his actions. Why he was so often 
apt to cover up what he had done with ex- 
cuses.” 

Client No. 14: “As for the consoling I hav 
had I can say this, It realy makes a man strip 
his mind bare, and when he does, He knows 
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then what he realy is and what he can do. Or 
at least he thinks he knows him self pretty 
well. As for myself, I know that my ideas 
were a little to big for what I realy am, but 
now I realize that one must stay start at his 
own level. 

Now, after four visits, I have a much clear- 
er picture of my self and my future, It makes 
me feel a little depressed and disappointed, but 
on the other hand, It has taken me out of the 
dark, the load seems a lot lighter now, that is 
I can see my way now, I know what I want 
to do, I know about what I can do so now that 
I can see my goal, I will be able to work a 
whole lot easyer at my own level....... a 

Client No. 29: “During the counseling pro- 
cess, | seemed to get an insight into myself, 
which wasn’t too pleasant.” 

Client No. 37: “This ‘guy’ came on like 
‘gang-busters’. His refreshing  triple-forte 
opening exploded me out of any tired accep- 
tance I might have had about myself. If I 
were to get any sympathy here it was to be of 
a booting, two-fisted variety. This man not 
only called a spade a spade—he called it a 
‘dirty shovel’. This struck deep. 

This man was awake, had an encouraging 
immediacy and a fine toughness in his ap- 
proach. He was naming in plain man-to-man 
language what I had tried to explain in fancy 
terms, the fancy, fake terms I had been trying 
to live my life in and had cluttered up because 
of them. This seemed to have touched a ten- 
der nerve, to be apropos of the over-all picture 
of my trouble. It challenged the phony reserve 
in my unconscious refusal to admit, and call 


THE CLIENT’S EVALUATION AND 
CRITICISMS 

The final evaluations of the results of 
the counseling process, from the stand- 
point of the clients, were derived from 
a comparison of the answers to ques- 
tions 1 and 3 (situation before and after 
counseling) and from any pertinent re- 
marks in the answers to question 2 
(relative to process). 

Because of the fact that the three 
questions asked were unstructured and 
because each client’s problems were 
unique and hence his responses were 
unique, to attempt an analysis of all the 
changes mentioned by the clients that 
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took place within them or their situa- 
tions as a result of counseling would be 
to involve us in too much detail. Such is 
not the purpose of this study, which was 
undertaken on an exploratory basis only. 
But, despite the fact that no attempt at 
an exhaustive content analysis has been 
made, a certain pattern is discernible 
in the results reported. 


I. Nondirective therapy did help the 
vast majority. 

Of the 37 clients under discussion, on- 
ly two reported that the counseling pro- 
cess had been of no assistance at all. 
One stated that he had been seeking 
more concrete advice and the other had 
the following to say (his document is 
quoted here in its entirety): 

Client No. 15: “When I came 
Mr. L. I didn’t know what to expect. 
mixed up about a lot of things and I can only 
say that I still am. Mr. L. was there to help 
me but from the start I didn’t feel that he 
would. From our first meeting to last I 
did not feel completely at ease. It was up to 
me to tell him all my and all about things in 
general but without to much help from him. 
I feel that I want him to talk with me more 
and draw me out. 


down to see 


I was all 


our 


It come right down to the 
fact that I didn’t have to much confidence in 
him to start with and with his maner he never 
gained that confidence. I will say that he 
helped me to see a few thing but I feel as 
though I had seen them before but in a differ- 
ent light. Maybe some day I’ll see just how 
much he helped me. I that day is not to far 
off.” 

II. The interviews offered an opportu- 
nity for catharsis. 

Of the 35 who reported satisfactory 
results, 12 stated that the interviews 
afforded them emotional release. Typi- 
cal comments were: 

Client No. 1: “I got a lot of things off my 
mind.” 

Client No. 6: “I left with a feeling that my 
problems were a burden which had been lifted 
from my shoulders.” 

Client No. 17: 


amount of relief.” 
Client No. 21: 


“I experienced a certain 


“It relieved the tension I 
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was under.” 
Client No. 26: “Complete vent of feelings.” 
Client No. 33: “Got things off my chest.” 


Of the twelve who stated that the in- 
terviews offered them an opportunity 
for emotional release, only three specified 
what they thought was responsible for 
making emotional release possible. One 
indicated that it was because the coun- 
selor was “understanding,” another be- 
cause the counselor “made it possible 
to tell all my mental controversies in 
such a manner that the embarrassment 
to me was at a minimum,” and the third 
said, “During the interviews, one was 
able to feel free to discuss whatever he 
thought would be necessary to try and 
clear up the condition which was exist- 
ing in the particular individual.” 


III. There was a marked change in at- 
titudes and self-concepts. 


Almost universally, there was a 
marked change in the client’s attitudes 
toward himself and others and definite 
evidence of confidence, hopefulness and 
clarity of purpose where formerly there 
had been confusion, insecurity and fear. 
The following quotations are typical of 
this change: 


Client No. 6: “As time went on, these prob- 
lems which I could not comprehend myself 
were simplified and I discovered that they were 
not as great as they actually seemed at first. 
He helped me overcome a feeling of despair 
which made the problems seem harder to look 
at. He sort of helped me see myself as others 
saw me, and at the same time, helped me 
see other persons as they saw themselves.” 


Client No. 11: [document quoted in its en- 
tirety]: “Before I started counseling I used to 
be very nervous when first meeting a person. 
I was more or less disgusted with some things. 

During the time I was in counseling I be- 
came used to talking to a person more per- 
sonally, which has helped me when talking to 
other people. I expressed my feeling of how 
I felt about things at home which I wouldn’t 
tell other people. 

Now that I am finished with counseling I 
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feel that I can face people more easily without 
showing my nervousness, I also fee] different 
towards things at home.” 

Client No. 18 [document quoted in its en- 
tirety here]: “First it has given me the power 
to voice my opinion of my self, and what thing 
there are in me I did not know be fore. 

I discussed my entire life and from all these 
point I gather the good and the bad and try 
to make some thing out of my life of what I 
have to live of it yet. 

Self confidence is one of the best qualities 
I found even though I had to change other 
peoples ideas of what I should do when they 
don’t under stand my point or try to consider 
theirs. 

Now I have to shape my life with the rest 
of the world and its people, good, and bad, 
and make it good. 

Make people under stand me; and I under 
stand them. 

Time is a element which will tell, how good 
my self confidence and good qualities have 
benefited me and others to the extent of social 
happiness and security.” 


Client No. 7 had changed so complete- 
ly as a result of counseling that when he 
was asked to recall what his situation 
was before counseling he could only say, 
“Now, as I think back to my condition 
before counseling, it all seems rather 
vague.” 


IV. A complete resolution of difficulties 
was often not necessary for clients to 
feel counseling had been of value. 


Of the 35 who expressed their satis- 
faction with the results of the counsel- 
ing process, 13 stated that they were 
satisfied despite the fact that they had 
not completely resolved their difficulties. 
That these clients were confident that 
they had gained enough from the coun- 
seling experience so that they could 
complete the working through of their 
difficulties on their own will be appar- 
ent from some of the excerpts cited be- 
low. 

Client No. 1: “Even though there is still a 
haze and air of mystery about my mental con- 


dition, I feel quite sure that they will eventu- 
ally clear away.” 


THE CLIENT EVALUATES 


Client No. 13: “Now I won’t say that I have 
complete peace of mind about this problem, 
but I have gotten off the road where I was 
getting more and more perturbed about it, & 
started clearing my mind of these complexes.” 

Client No. 24: “Truly I can’t say that I’ve 
made as much progress as I’d like but, I’m go- 
ing forward slowly that’s to be sure. Seem- 
ingly the more I know of myself the more I 
want to learn about ‘me’. I think to know my- 
self thoroughly would help to know other peo- 
ple really better. 

The future will aid in finding just how much 
progress I’m making. One thing I’m certain 
to be aware of things that go on, and maybe 
searching myself for methods of improving 
might make me more conscious of how I go 
about doing things and the reasons why. 

I’m satisfied to know that I’ve made a step 
further.” 

Client No. 26: “Clearer view of solution to 
problem and a general outline formed in my 
own mind of a method to attack what concrete 
evidence remained of what was formerly 
thought to be a large problem.” 


SUGGESTIONS FOR IMPROVEMENT OF THE 
TECHNIQUE OFFERED BY CLIENTS 


As has already been indicated, there 
were three clients who, at the end of the 
counseling process, still felt that the ex- 
perience would have been of more value 
to them if the counselor had presented 
his own point of view and had offered 
advice. One of these three clients, No. 
23, was also one of the clients who were 
completely dissatisfied with the results 
of the counseling process. The other 
suggestion that he made was that the 
counselor “make more comments.” 

The only other suggestion for impro- 
ving the counseling technique was found 
in the document of client No. 36, who 
stated: 


After counseling I feel more able to cope 
with problems that face me. What I would 
have liked (and still would!) was a session 
devoted to summing up. An explanation of 
why I behaved as I did, etc. and what changes 
in pattern were indicated for happiness. 


COMPLETE DOCUMENT 
Earlier in the paper, several complete 
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but short documents were presented in 
their entirety to illustrate pertinent 
points. However, in order to give the 
reader a picture of the full flavor of the 
average-sized document received, one 
written by a client with a rather good 


command of language, is presented be- 
low. 


Client No. 27:1) Before I took this counsel- 
ing help I was so tied up mentally that I 
feared at times during the last fifteen years 
that I wouldn’t be able to go on. At home I 
felt secure, my mind was at ease, simply be- 
cause I knew my own family, but once I left 
the house it was another story. I was tense, 
fearful all the time of other people and what 
they might be thinking. I couldn’t meet their 
eyes for more than a minute or so without 
this fear growing. 

For some years I’ve tried to become a writer 
in my spare time but something seemed to be 
missing from all that I wrote. Consequently 
my stories were always rejected, with one ex- 
ception, that I regard more as a bit of luck. 
I happened to straighten out for a brief half- 
hour and put some of myself into the story. 
The story sold the first trip out. 


This situation was becoming unbearable 
when I left the army and entered the College 
of Optometry. I felt like an outcast and kept 
more or less to myself. I couldn’t help feeling 
that they thought I was strange or somewhat 
screwy. Life in general had become a daily 
ordeal. 

2) Two months ago I took a vocational apti- 
tude test and personality test the results of 
which bore out my feelings. I had ability in 
the field of writing but I was emotionally un- 
stable. I was introduced to Mr. L.,; the Veter- 
ans’ Counselor, and a date was set for our 
first talk. That day came. I started to talk 
of the things that had bothered me, and, at 
intervals, Mr. L. solidified my ramblings into 
a few clear, concise words. [Note: at this 
point, the client had put a footnote, which fol- 
lows. ] 

To elaborate on this paragraph: Many of 
the thoughts and fears in my mind were vague 
—I couldn’t say exactly what they were. I 
couldn’t put them into exact, clear words. The 
fear was the thing that overwhelmed my 
thoughts. I had never seen these clearly. I 
couldn’t put it into words that seemed to mean 
anything to me. 

Mr. L. took these vague thoughts and fears 
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and put them into words that I could under- 
stand and see clearly. By doing so I could see 
clearly their degree of importance. Some of 
the things I was afraid of now seem unimpor- 
tant as they actually were. Fear, though is 
something that combats reasoning. I needed 
help and Mr. L. gave it to me. [end of foot- 
note} 

This type of psychological help seemed 
strange to me at the first meeting. I wondered, 
“How in the devil can this help me—just talk- 
jing about things that weren’t even clear to 
me?” I won’t deny that after that first meet- 
ing I doubted whether he could help me. 

During the second meeting I received my 
first jolt. Taking my vague thoughts he told 
me in a few words what they really meant. I 
broke out in a sweat, I was trembling, some- 
what panicky. Those few words had opened 
the door for me. When I walked out into the 
street after that meeting it was as though I 
were in a new world. The people looked diff- 
erent, more human, the world seemed a better 
place to live in. 

In school I applied some of the things I had 
learned and found that they worked. I seemed 
to get along better with the other students. and 
at times the fear and tension almost vanished. 
At times, though, it became just as bad but it 
came in waves now that receded when I made 
an effort. 

8) During subsequent meetings I learned 
more and more about myself, until today, our 
fifth meeting, I told him the real trouble that 
was bothering me—all of my other fears that 
I had told him about in previous meetings be- 
ing related to this main fear. 

A night ago I wrote another piece of fiction 
and for the first time in six years it had every- 
thing in it that I wanted to say. It was good, 
and my friends verified this. 

It was an immediate relief to get rid of 
these fears, the tension and the misery that 
goes with it. 

I realize now that I must apply what I’ve 
learned to my every-day relationships with 
people. In time I know that all trace of this 
fear will disappear. 

I owe this peace of mind to Mr. L. and to no 
one else. [ Italics indicate client’s underscor- 
ing. ] 


SUMMARIZING DISCUSSION 
BY CARL R. ROGERS 


In examining the reactions of these 37 
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clients as to how they felt before, dur- 
ing and after counseling, it seems clear 
that their understanding of the process 
as seen from the client’s viewpoint cor- 
roborates the descriptions given by 
those writing about nondirective thera- 
py. The major elements experienced ap- 
pear to be: the taking of responsibility 
for oneself in the counseling relation- 
ship, which some welcome and some do 
not; the release of emotional tensions; 
the exploration of emotionalized atti- 
tudes, including those which have been 
denied to conscious awareness; the 
clearer understanding of self; the re- 
organization of attitudes toward the 
self; the choice of steps which will solve 
or partially solve the problem. 

Several of the group specifically men- 
tion that they believe the attitudes 
achieved will assist them in handling 
future problems. Others feel that the 
experience will change the quality of 
the relationships they have with others. 

It would appear that a greater ac- 
ceptance of self is one of the elements 
experienced by these clients. This seems 
to involve a more objective view of self, 
a facing of undesirable attitudes and an 
acceptance of them as a part of self, a 
more realistic appraisal of abilities, and 
a more spontaneous and confident utili- 
zation of the realistic self. 

It is perhaps of significance that 35 
of the 37 clients feel that they have been 
helped, and appear to have gone 
through a characteristic process in 
achieving varying degrees of help for 
themselves. In one of the two reporting 
no gain, it appears that the process 
went as far as the exploration of atti- 
tudes, but then was truncated. The 
statement that a client-centered type of 
counseling seems to initiate a typical 
and predictable process appears to be 
supported by these expressions from 
clients. 


A FURTHER STUDY OF TWO SHORT FORMS OF THE 
WECHSLER-BELLEVUE SCALE 


By C. H. PATTERSON 


VETERANS ADMINISTRATION 
MINNEAPOLIS, MINN.! 


N A PREVIOUS paper [5] five pro- 

posed short forms of the Wechsler- 
Bellevue Scale were compared. These 
short forms included Rabin’s [7] Com- 
prehension, Arithmetic and Similari- 
ties; Cummings’ [1] Arithmetic and 
Comprehension; Gurvitz’ [3] Digit 
Span and Picture Arrangement; and 
two forms suggested by Geil [2], one 
consisting of Comprehension, Similari- 
ties, Digit Span and Block Design, and 
the other of Information, Picture Com- 
pletion, Picture Arrangement, and Digit 
Symbol. These forms include all of the 
subtests of the Wechsler except Vocabu- 
lary and Object Assembly, though not, 
of course, all possible combinations. 

Since vocabulary has long been con- 
sidered one of the best single measures 
of intelligence (the Vocabulary subtest 
of the Wechsler correlates about .85 
with the total scale), and is useful in 
clinical appraisal, two additional short 
forms including the Vocabulary subtest 
were compared, in the study referred to, 
with those listed above. These two short 
forms consisted of (1) Vocabulary, 
Comprehension, Block Designs and Pic- 
ture Completion, and (2) Vocabulary, 
Comprehension and Digit Symbol. It 
was found that in terms of correlation 
with full scale scores, and in terms of 
the average differences aud ranges of 
differences between actual full scale 
scores and equivalent full scale scores 
estimated from the short forms, the two 


'The opinions and conclusions presented in 
this paper are those of the author. 
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short forms including Vocabulary were 
superior to other short forms consist- 
ing of an equal number of subtests. It 
was also felt that these short forms, in- 
cluding Vocabulary, retained more clini- 
cal value, since they included both Verb- 
al and Performance tests, and tests 
sensitive to clinical impairment which 
could be evaluated in terms of deviation 
from Vocabulary. 

The sample used in this comparison 
of seven different short forms of the 
Wechsler consisted of 50 patients in an 
Army overseas hospital specializing in 
the care of closed ward patients. The 
group included the major neuroses and 
psychoses [5, 6]. The groups used by 
Cummings, Geil, Gurvitz, Rabin and 
Springer were composed of recruits 
suspected of being mentally retarded, 
prisoners, and hospital patients. The 
mean I.Q. in all these groups was below 
average. Rabin also, however, utilized 
a group of 92 student nurses with I.Q.’s 
from 85 to 130, but found the correla- 
tions of the CAS short form with Verb- 
al, Performance and Full Scale scores 
lower than in his group of 200 patients. 

It is important in a short test to be 
used in screening large numbers of indi- 
viduals, the majority of whom are nor- 
mal, that its effectiveness in estimating 
or predicting full scale scores in a nor- 
mal population, with a wide range of 
I.Q.’s, be demonstrated. Hunt, Kleban- 
off, Mensh and Williams [4] have 
checked several of the earlier proposed 
short forms of the Wechsler against 








148 


A.G.C.T. scores, and against scores 
based on six of the subtests of the Wech- 
sler-Bellevue Scale, including the sub- 
tests used in the short forms, in a sample 
of over 500 normal Naval recruits. They 
found that a combination of two of the 
Wechsler-Bellevue subtests (Compre- 
hension and Similarities) and a vocabu- 
lary test consisting of 15 words adapted 
from R. L. Thorndike gave the best re- 
sults, thus substantiating the use of a 
vocabulary test in a short scale of intel- 
ligence. However, the complete Wech- 
sler-Bellevue scale, including Vocabu- 
lary, was not administered to these sub- 
jects, so that evaluation of the two short 
forms proposed by the writer could not 
be accomplished in this large normal 
population. 

Obtaining a group of normal individ- 
uals who have been given the Wechsler- 
Bellevue scale with Vocabulary is a 
rather difficult task, since the Vocabu- 
lary test is not customarily given, and 
in addition, the Block Designs test is 
often omitted because of lack of the 
blocks. However, the writer has obtained 
100 cases upon which to check the short 
forms utilizing Vocabulary as one of the 
subtests. 

Sample. Three different subgroups 
are represented in the total sample of 
100. One group consists of 40 male vet- 
erans tested at the St. Paul Board of 
Education Veterans Guidance Center.’ 
They are selected to represent the gen- 
eral run of veterans receiving vocation- 
al guidance. The majority have no physi- 
cal disabilities, though a few have mi- 
nor, nonpsychiatric conditions. Ages 
range from 18 to 34, with a mean of 
22.9 years; education ranges from 3 to 
14 years, with the mean at 9.75. The 
mean Full Seale 1.Q. is 103.8, with a 
range from 78 to 134. 

The data for 29 males were made 


2The writer is indebted to Mr. E. L. Phillips 
for the use of the test data on this group. 
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available by Dr. J. F. T. Bugental of the 
Psychological Clinic of the Ohio State 
University. These include subjects test- 
ed by graduate students in a course in 
testing, subjects tested in counseling and 
guidance work, who were free from ob- 
vious signs of maladjustment or disa- 
bility, and patients in an Army General 
Hospital, without neuropsychiatric di- 
agnoses or evidence of maladjustment. 
They range in age from 13 to 38 (though 
only one is below 18 and one above 33), 
with a mean of 24.4 years. Education 
(N=27) is from 5 to 16 years, with a 
mean of 10.9; Full Scale I1.Q.’s range 
from 70 to 135, with the mean at 108.0. 
These cases are diverse in nature, and 
probably are not representative of the 
entire normal population. However, 
they do not include subjects with mal- 
adjustments severe enough to warrant 
hospitalization. 

To complete the sample of 100 cases, 
31 of the subjects in Rapaport’s con- 
trol group of Kansas State Highway pa- 
trolmen [8] were utilized. All except 3 of 
the subjects under 36 years of age were 
taken, and the data in Rapaport’s appen- 
dices used to compute the desired scores. 
These subjects range in age from 25 to 
35, with the mean at 30.1. Education 
ranges from 9 to 16 years, with the 
mean at 12.6. Full Scale I1.Q.’s range 
from 98 to 131 (recomputed, to include 
Vocabulary), with the mean at 116.0. 

The population characteristics of the 
total group of 100 are given in Table I. 

TABLE I 
POFULATION STATISTICS FOR 100 NORMAL ADULTS 
USED IN THE STupy oF Two SHORT 


FORMS OF THE WECHSLER- 
BELLEVUE SCALE 











Standard 
Mean Deviation Range 
Age 25.56 5.03 13 to 38 
Education 
(N98) 10.96 2.65 3 to 16 
Intelligence* 108.83 17.21 70 to 135 





bd Including Vocabulary, prorated. 


TWO SHORT FORMS OF THE WECHSLER-BELLEVUE 


While the group as a whole is not en- 
tirely representative of the general pop- 
ulation, being somewhat above average 
in intelligence and education, and being 
overweighted by a large proportion of 
patrolmen, it is probably sufficiently 
normal in composition and sufficiently 
representative of the nonhospitalized 
population to contrast with groups uti- 
lized in previous studies of short forms 
of the Wechsler scale. 

Results. Table II shows the correla- 
tions of each of the two short forms of 
the Wechsler-Bellevue Scale with Ver- 
bal, Performance and Full Scale scores. 
Table III compares the actual Full Scale 


TABLE Il 


CORRELATIONS OF SHORT FORMS OF THE WECH- 
SLER-BELLEVUE SCALE WITH VERBAL, PER- 
FORMANCE AND FULL SCALE SCORES 





Full 

















Perform- 

Short Form Verbal* ance Seale* 
Vocabulary, Com- 

prehension, 

Block Design, 

Picture Com- 

pletion .870 (.922) 877 (.912) .955 (.962) 
Vocabulary, Com- 

prehension, Dig- 

it Symbol .869 (.912) -742 (.849) -896 (.934) 

* Including Vocabulary. 

Figures in parentheses are those of the earlier study 


[5]. 


Weighted Score means with the esti- 
mated or Full Scale Equivalent Weight- 
ed Score means, and gives the average 
differences and the ranges of differences 
between the actual Full Scale scores and 
the short form Full Scale Equivalent 
scores. The figures in parentheses are 
those obtained in the previous study of 
50 hospitalized subjects. 

The correlations are slightly lower 
than those obtained in the previous 
study, the greatest difference being that 
between the correlations of the three- 
subtest short form with the Perform- 
ance scale. It may be that in normal in- 
dividuals the Digit Symbol subtest is 
not as representative of the general 
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TABLE III 
MEAN FULL SCALE WEIGHTED SCORES, SHORT 
FoRM EQUIVALENT WEIGHTED SCORES, AND 
DIFFERENCES BETWEEN ACTUAL FULL SCALE 
WEIGHTED SCORES AND FULL SCALE EQUIVA- 
LENT WEIGHTED SCORES ON THE WECHSLER- 
BELLEVUE SCALE 


Short 


een Actual Full 
Form Equivalent 


e Score and 





Average Difference 
ang< of 


Test Combination 
and Subgroup 
Mean Weighted 


Differences 


R 





| 


Full Scale: 
Group I 
(N=40) 
Group II 
(N=29) 106.90 
Group III 
(N=31) 
Total 
(N==100) 


116.77 


108.10 (64.2) 


Vocabulary, 
Comprehen- 
sion, Block 
Design, 
Picture 
Completion 

Group I 
Group II 


166.25 5.55 
111.52 6.85 
Group III 120.55 6.19 
Total 112.21 (66.8) 6.12 (6.2) 12 to-+ 
Vocabulary, 
Comprehen- 
sion, Digit 
Symbol 
Group I 7.6 19 to + 
Group II 102.34 7.79 19 to 
Group III 
Total 


65 7.32 


108.08 (64.5) 7.57 (7.7) 


13 to 
19 to 


17 to 22) 








* Full Scale Weighted Score Equivalents for the short 


forms were computed by multiplying the mean subtest 


score for each form by ten. 


Figures in parentheses are those of the earlier study 
[5]. 


level of performance ability as in a pa- 
tient population. Wechsler [10, p. 95] 
notes that unstable individuals do poor- 
ly on this test, however. Rapaport [8, 
p. 293] reports that in his normal group, 
from which 31 of the present cases were 
taken, Digit Symbol was not below the 
Performance mean. In the “Ohio” cases, 
however, the average Digit Symbol score 
is 1.5 weighted score points below the 
Performance average. It is possible 
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that the presence of anxiety in this 
group has affected this test as well as 
Digit Span. 

From Table III it appears that the 
four-test short form tends to overesti- 
mate the Full Scale score. This tend- 
ency appeared in the previous study but 
was not as marked. An inspection was 
made of the subtest scores for those 
cases in which the deviation of the Full 
Scale Equivalent was 10 points or more 
from the actual Full Scale score. For 
the four-test form the results suggest 
that in those cases of high overpredic- 
tion (21 cases), low Digit Span, Arith- 
metic and Digit Symbol scores were 
present in 16, 10 and 7 cases respective- 
ly. There were only 2 cases of under- 
prediction by 10 points or more for this 
form. For the three-test short form, of 
21 cases in which the short form over- 
predicted by 10 points or more, low 
Digit Span, Arithmetic and Picture 
Completion scores were present in 13, 8 
and 9 cases respectively. Of the 15 
cases with underprediction of 10 points 
or more, Vocabularly and Comprehen- 
sion were low in 7 and 8 cases respec- 
tively, and Digit Symbol in 10 cases. 

These results suggest that in more or 
less normal subjects of average or bet- 
ter intelligence, the Digit Span, Arith- 
metic and Digit Symbol scores (the lat- 
ter at the lower intelligence levels) are 
apt to be depressed. The Digit Span 
test appears to be the test most fre- 
quently out of line with the average sub- 
test scores. Its correlation with the to- 
tal test (minus Digit Span) in Wech- 
sler’s group of 355 cases (ages 20-34) 
was .509, the lowest of any test except 
Object Assembly [10, p. 324] Rapaport 
[8, p. 193] states that a low Digit Span 
score is mainly indicative of anxiety, 
and since anxiety is a feature of most 
groups, clinical and normal, the Digit 
Span score is apt to be low, and is not a 
diagnostic indication unless extremely 
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deviant. Wechsler [10, p. 83] states that 
it is a poor test of general intelligence 
except at the lower levels. It would ap- 
pear that it might be justifiable to omit 
the Digit Span score in computing intel- 
ligence scores and quotients in indivi- 
duals of average or above average intel- 
ligence. If this were done it is probable 
that short forms of the test would yield 
better estimates of the total scale. 


TABLE IV 
DIFFERENCES AND RANGES OF DIFFERENCES BE- 
TWEEN ACTUAL FULL SCALE WEIGHTED SCORES 
AND SHORT FORM EQUIVALENT WEIGHTED 
SCORES BY INTELLIGENCE LEVELS (FULL 
SCALE) 











Vocabulary, Comprehen- Vocabulary, Compre- 

sion, Block Design, hension, Digit Symbol 

Picture Completion 
Mean 


Diff. 


Mean 
Diff. 


1.Q. Level 


Range Range 








70-100 

(N=25) 3.76 6to+ 8 8.60 
101-120 

(N=52) 6.15 
121 & over 

(N==23) 8.60 


19 to +18 
1l to +16 


19 to +20 


12 to +19 5.70 15 to +15 





In Table IV the data on differences 
and ranges of differences reported in 
Table III are broken down into three 
1.Q. groups: 70-100, 101-120, and 121 
and over. From these data it is appar- 
ent that the four-test short form pre- 
dicts the total score better at the lower 
1.Q. levels, and becomes progressively 
less accurate as the I.Q. increases. This 
is consistent with the fact that the Digit 
Span score is less valuable at the higher 
levels as a measure of intelligence, and 
depresses the total score, contributing 
to overestimation by short forms not in- 
cluding this subtest. There is no differ- 
ential tendency to over- or underesti- 
mate in the three I.Q. groups. The 
three-test short form, on the other hand, 
predicts more accurately at the higher 
1.Q. levels. At the lowest level this short 
form tends to underpredict, while at the 
higher levels there is a slight tendency 
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to overpredict. This may be partly due 
to the influence of Digit Span, as in the 
four-test form, and possibly in part the 
result of the generally relatively higher 
Performance score at the lower levels 
(only one performance test being includ- 
ed in this short form), to the tendency 
for Digit Symbol to be depressed in the 
lower intelligence levels, or to both. 
Summary and Conclusions. Two short 
forms of the Wechsler-Bellevue Scale 
proposed in a previous study of hospital 
subjects were checked in a sample of 
100 more or less normal males, more 
or less representative of the population 
which would be met with in screening 
situations. Correlations with Verbal, 
Performance and Full Scale scores were 
slightly lower than those obtained in the 
patient population, while the average 
differences and ranges of differences be- 
tween obtained and estimated Full Scale 
scores were closely similar for the group 
as a whole. However, there was a more 
marked tendency for the four-test short 
form (Vocabulary, Comprehension, 
Block Design and Picture Completion) 
to overestimate the Full Scale score. 
This tendency appeared to be partly due 
to the fact that the Digit Span, Arith- 
metic and Digit Symbol scores were de- 
pressed in many of the subjects where 
the discrepancy between the actual and 
the estimated scores was greatest. 
Although the three-test short form 
(Vocabulary, Comprehension and Digit 
Symbol) showed no tendency to over- 
or underestimate total scores for the 
entire group, discrepancies in the direc- 
tion of underestimation appeared to be 
influenced by low Digit Span, Arithme- 
tic and Picture Completion scores, and 
discrepancies in the direction of over- 
estimation appeared to be influenced by 
low Digit Symbol scores, in addition to 
relatively low Vocabulary and Compre- 
hension scores, particularly in the 
“Ohio” subgroup, which is perhaps less 
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“normal” than the other two subgroups 
and more susceptible to the influence of 
anxiety on the Digit Symbol test. 

A comparison of the results in terms 
of 1.Q. levels indicated that the four- 
test combination is probably more ac- 
curate at the lower I.Q. levels (70-121, 
particularly under 100), while the three- 
test short form is apparently better at 
the higher I.Q. level (over 120 I1.Q.). 

In can be concluded that these three- 
or four-subtest combinations are useful 
in screening large numbers of normal 
individuals, or in obtaining an estimate 
of intellectual level in individuals in a 
large hospital population where time 
precludes the administration of the full 
scale to all patients. However, in indi- 
vidual cases the Full Scale I1.Q. may be 
over- or underestimated by as much as 
15, or even 20, I.Q. points. This would 
indicate that caution is needed in inter- 
preting I.Q.’s obtained from short forms 
of the scale. The fact that subtest scores 
on the three or four tests utilized in the 
short form show little deviation from 
each other cannot be taken as an indi- 
cation of the accuracy of the estimate 
on the basis of these tests, since in some 
cases of this nature other subtest scores, 
particularly Digit Span, Arithmetic and 
Digit Symbol, vary considerably, usual- 
ly depressing the actual Full Scale 
score below the estimated score. It is 
possible that at the higher I.Q. levels 
the omission of the Digit Span test 
would result in more valid intelligence 
scores for the Full Scale, which could 
be better predicted by short forms of 
the scale. 

It also appears that short forms vary 
in their accuracy at different levels of 
intelligence. In this study the four-test 
form appeared to be better at the lower 
levels (particularly under 100), while 
the three-test form gave more accurate 
estimates at the higher level (over 120). 
Since they both include Vocabulary and 
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Comprehension, it would be possible 
after administering these two tests to 
estimate the relative level of intelligence 
and to be guided by this in determining 
whether to administer the four-test or 
the three-test combination. 

It would be desirable to repeat this 
study, including perhaps several other 
short forms of the Wechsler, in a larger, 
more representative population, includ- 
ing noninstitutionalized mental defec- 
tives, to which the complete Wechsler- 
Bellevue Scale, including the Vocabu- 
lary test, had been administered. 
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SELF REFERENCE IN COUNSELING INTERVIEWS' 


By VICTOR C. RAIMY 


THE OHIO STATE UNIVERSITY 


UCCESSFUL counseling or psycho- 
S therapy implies that changes take 
place in the personality of the client or 
patient. The problem of the psycholo- 
gist who seeks to analyze conscious, de- 
liberate attempts to alter behavior in a 
clinical situation, lies essentially in de- 
termining specifically what changes take 
place during treatment and what condi- 
tions are necessary to produce them. 
Many things have been suggested as 
“essential changes” but so far there is 
almost a complete dearth of reliable evi- 
dence, aside from clinical interpreta- 
tions, to bolster the constructs which 
have been advanced. Among the terms 
in common use which supposedly define 
such changes are release of feelings or 
tensions, emotional re-education, mak- 
ing the unconscious conscious, modify- 
ing responses, reorganization or reinte- 
gration of personality, modification of 
goals or pathways to goals, etc. 

Such terms are so schematic, so indef- 
inite or so circular that the very exist- 
ence of the psychological events to 
which they refer cannot be determined 
by objective measures or else every 
event considered fits the theory. Changes 
in “needs” or in “attitudes” or in 
“traits” have also been suggested as oc- 
curring in therapeutic situations as well 
as in normal personality development. 
So far there has been little systematic 


‘A condensation of a portion of a Ph.D. the- 
sis submitted to the Graduate School of the 
Ohio State University in 1943. Acknowledg- 
ments are gratefully made to Professors Carl 
R. Rogers, Horace B. English and Harold A. 
Edgerton for their encouragement and criti- 
cisms, 


application of these concepts to the arti- 
ficially induced changes occurring dur- 
ing treatment. As for trait constructs, 
in clinical work these have usually been 
applied to manifestations of ability or 
capacity which the counselor is more in- 
terested in unmasking than in modify- 
ing. 

It becomes imperative to search for 
constructs which investigated 
with the usual safeguards of objectivity 
and reliability. When and where to ap- 
ply available and plausible measures is 
at present a matter of feasibility rather 
than desirability. The methods of meas- 
urement are crude and time consuming. 
Clinicians are usually unwilling to dis- 
turb both their own delicate methods of 
treatment as well as the precarious bal- 
ance achieved by the individuals treated. 
The application of measuring methods 
has been a matter of catch-as-catch-can, 
although recent developments in the use 
of recording equipment open a new 
field for the analysis of hitherto unob- 
tainable data within which may be 
found some of the essential clues. Un- 
fortunately, techniques for analyzing 
verbatim interview material are in their 
infancy. 

Most certainly, the events taking place 
in the counseling interview are the 
events which furnish a very logical fo- 
cus and locus of investigation. It is 
equally certain that even verbatim re- 
cordings furnish only selected portions 
of the interview events. Such record- 
ings contain only the remarks of the 
counselor and the client’s verbalizations, 
most of which are concerned with him- 


can be 
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self and his relations to other people. 
How can one abstract from such mater- 
ial clues which are relevant to the basic 
problem of how personality undergoes 
change? 

The Self-Concept and Personality Or- 
ganization. Perhaps in the search for 
dominant factors in personality the ob- 
vious has been too long neglected be- 
cause it is obvious and therefore 
deemed unworthy of attention. In our 
sophisticated intercourse with personal- 
ity dimensions which require for their 
comprehension a neologism, a factor 
analysis or a re-redefinition, it is only 
too easy to neglect in the laboratory 
much of the wisdom we use in the par- 
lor or office. 

What a person believes about him- 
self is a generally accepted factor in 
the social comprehension of others. 
Peculiar or just different behavior in 
our associates can frequently be under- 
stood by clichés such as “He has an in- 
feriority complex” or “She is conceit- 
ed.” In such thumb-nail analyses we 
are referring to a description of him- 
self which the person referred to has 
apparently accepted and acts upon. The 
analysis, if accurate, is useful in under- 
standing others even when we are ig- 
norant of the historical development of 
the self-belief, as is usually the case. 

In the present study, the Self-Con- 
cept theory postulates that a person’s 
notion of himself is an involved, com- 
plex and significant factor in his be- 
havior. One can build a systematic the- 
ory of personality organization which 
neglects neither historical nor physio- 
logical events yet depends essentially 
on the data of immediate experience. 
Briefly, the Self-Concept theory (or 
the Body-Schema of Schilder or the Ego 
of Koffka) predicates that each indi- 
vidual’s perception of himself is of ulti- 
mate psychological significance in or- 
ganized behavior. The person in his 
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biological, social and historical setting 
is the concrete object of self-percep- 
tion. The Self-Concept is the more or 
less organized perceptual object result- 
ing from present and past self-observa- 
tion. Self-perception is a process which 
is more than activation of internal or 
distance receptors. In agreement with 
text-book definitions, there is in self- 
perception an organization which in- 
volves memorial and situational factors 
as well as the sense data themselves. 

To oversimplify the theoretical posi- 
tion, one can say that we perceive our- 
selves just as we perceive a chair or 
another person. What we perceive in 
ourselves (the Self-Concept) may have 
only partial correspondence with what 
other people perceive in us or the so- 
called objective personality. Yet, as 
always, we behave in accordance with 
our own perceptions even though the 
opinions of others or the urgencies of 
our biological make-up interact to influ- 
ence our perceptions of ourselves. Our 
general behavior, then, is to a large ex- 
tent regulated and organized by what 
we perceive ourselves to be just as be- 
havior toward a chair is regulated by 
our perception of a given chair. When 
tired we observe what appears to be a 
rickety antique and walk away in 
search of something more substantial 
quite unaware that the wary hostess 
has introduced reinforcements at the 
joints. In the same way, we may per- 
ceive ourselves to be fatigued and spend 
hours resting when the physiological 
facts may or may not be in agreement 
with our self-perception. 

How can Self-Concept theory be ap- 
plied to those changes which take place 
in personality during counseling and 
psychotherapy? It is exceedingly diffi- 
cult to obtain objective and meaningful 
data from the verbalizations which are 
the raw material of immediate experi- 
ence. Some studies of content changes 
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before and after counseling have been 
made by the writer but these are frag- 
mentary approaches. The method chos- 
en in the present study postulates that 
self-approval and self-disapproval rep- 
resent two ends of a continuum which 
may be viewed as one of the major di- 
mensions of the Self-Concept. McDoug- 
all’s “sentiment of self-regard” obvi- 
ously refers to this fact: that persons 
make self-evaluations. He says [4, p. 
428] concerning the ubiquity of this 
sentiment: 


And the conative dispositions of the system, 

being brought into play so frequently, by every 
social contact whether actual or imagined, be- 
come delicately responsive in an extraordinary 
degree, as well as very strong through much 
exercise. 
This study was therefore directed to- 
ward simple quantitative analysis of 
changes in self-approval displayed by 
college student clients. Fourteen com- 
plete series of counseling interviews 
were analyzed. 

The basic postulations of the study 
were as follows. The Self-Concept is 
the map which each person consults in 
order to understand himself, especially 
during moments of crisis or choice. 
The approval, disapproval or ambiva- 
lence he “feels” for the Self-Concept or 
some of its sub-systems is related to his 
personal adjustment. A heavy weight- 
ing of disapproval or ambivalence sug- 
gests a maladjusted individual since 
maladjustment in a psychological sense 
inevitably implies distress or disturb- 
ance in connection with oneself. When 
successful personality reorganization 
takes place in a maladjusted individual 
we may also expect a shift from self- 
disapproval to a positive or self-approv- 
ing balance. The adjusted individual 
may dislike or disapprove of certain as- 
pects of the Self-Concept but in general 
he finds himself to be attractive and de- 
sirable. The studies of self-ratings, 
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presumably carried out on unselected 
populations, corroborate the final pos- 
tulation. Allport summarizes [1, p. 
444], “In self-ratings there is a tend- 
ency to overestimate those qualities 
considered desirable and to underesti- 
mate those considered undesirable.” 

The present study was limited by the 
small number of completely recorded 
counseling cases available. Despite this 
limitation, other investigators have used 
similar methods and emerged with 
fruitful hypotheses if not completely 
defensible conclusions. These studies, 
beginning with Porter’s [5] highly 
original exploitation of the check list 
method with interviews, are carefully 
reviewed in Curran’s recent book [3]. 

The Method of Classifying Self-Ref- 
erences. In order to quantify the ver- 
balized changes in self-approval taking 
place during counseling, a six category 
checklist was devised to permit classi- 
fication of all client utterances. Repro- 
duced below is a summary of the meth- 
od used to classify verbatim transcripts 
of 14 completely recorded counseling 
cases. The summary is an abridged 
form of a six page set of instructions 
given to four judges who participated 
in determination of reliability. 


SUMMARY OF DIRECTIONS FOR CLASSIFYING 
SELF-REFERENCES 


Purpose: To classify the responses of clients 
in counseling interviews into categories based 
on the client’s attitude toward himself. It is 
hoped that this procedure will be useful as a 
means of showing changes in the client during 
the course of counseling. 

Definition of Self-References: A Self-Refer 
ence (SR) is a group of words spoken by the 
client which directly or indirectly describes 
him as he appears in his own eyes. In a coun- 
seling interview the client is usually discuss- 
ing himself and his reactions. Responses of 
the client which are not self-references are 
called External References or “Other” 
symbolized as “O”. 

The Unit is the Client’s Complete Response: 
A complete response consists of all words spok- 


and are 
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en by the client between two responses of the 
counselor. Each numbered response of the cli- 
ent in the typescript is to be classified for its 
self-reference cvaluation or lack of self-refer- 
ence. For purposes of brevity, the self-evaluat- 
ing aspect of the response is referred to as its 
“value”, which is simply the positive or nega- 
tive attitude toward self manifest in the re- 
sponse. 

The Task of the Judge: 1. Read through 
the complete interview or portion of an inter- 
view in order to familiarize yourself with the 
general content of the material and the man- 
ner of speaking of the client and counselor. 2. 
Starting with the first numbered client re- 
sponse, decide whether it is a self-reference or 
external reference. 3. If it is an SR, classify 
it in one of the categories described below. 4. 
The decision as to the meaning intended by the 
client in a particular response should rest 
upon a commonsense deduction and should not 
be a tenuous theoretical deduction based upon 
a series of inferences. 


The Six Categories: 


bP... . Positive SR indicating a positive or 
favoring attitude toward self. 

N .... Negative SR indicating a negative or 
disapproving attitude toward self. 

Av ... Ambivalent SR in which there is a 


clear conflict between the positive 
and negative attitudes toward self in 
the same response. 


A .... Ambiguous SR in which some self- 
reference is manifest but either the 
value is too vague to be classified or 
the response lacks value altogether. 


O.... Other or External Reference in 
which the client himself is not im- 
plicated. 

Q....A nonrhetorical question in which 


the client is actually asking for infor- 
mation. If a question is only part of 
a complete response, the question is 
ignored in the classification. 


Some Problems Involved in the Meth- 
od. Finding units in oral material is no 
less difficult than finding the units ot 
any psychological event. The arbitrary 
definition of the unit in this study as 
all words spoken by the client between 
two utterances of the counselor pro- 
vides objectivity and avoids the frac- 
tionation which so often obscures mean- 
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ing. It is possible that some of the cli- 
ent responses treated as units may be 
fragments of units or may be multiple 
units. While the unit of self-reference 
may be patently nonunitary in some in- 
stances, it is defined objectively and 
repetition of the procedure becomes 
possible. 

A further problem is found in the 
assumptions underlying the use of a 
method which simply summates the re- 
sponses in each category for a com- 
plete interview. Why should one expect 
to obtain an accurate indication of a 
client’s attitude toward himself by such 
a procedure? Logic would predict that 
certain factors in the interview situa- 
tion such as reactions to the counselor, 
defensiveness, etc. would result in dis- 
tortions of the true attitudes. It is be- 
lieved that distorting factors are pres- 
ent and do operate particularly during 
early stages of contact. It needs little 
imagination to envisage the clumsy or 
ardent interviewer forcing a client into 
defensive or angry self-description. 
When, however, the counselor aims 
skillfully at obtaining free expression 
by the client, there is reason to sus- 
pect that the resulting responses will 
bear a considerable resemblance to the 
picture which the client perceives. The 
use of simple summation as a method 
of analysis is crude and liable to a vari- 
ety of distorting factors. The problem 
thus becomes one of validity. One can 
theorize that an individual will reveal 
himself by the quantity of his self- 
references as well as in the quality of 
any selected individual response. Per- 
haps the frequency with which a per- 
son returns to a given topic indicates 
the concern or importance that topic 
has for him. Concretely, if a person 
thoroughly approves of himself we 
should expect to find very few if any 
statements of self-depreciation in free 
conversation. (Stylistic phrases intend- 
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ed to insure modesty are not difficult to 
identify.) Present day measures of per- 
sonality, projective or nonprojective, 
utilize such a frequency principle in 
one form or another. 

The Reliability and Objectivity of 
the Method. Two determinations of re- 
liability were made. The writer classi- 
fied two complete cases totalling 874 
client responses in 13 verbatim inter- 
views.? Six months later he reclassi- 
fied the same material without refer- 
ring to the earlier classification. A fre- 
quency count of the number of times 
the same response was reclassified in 
the same category revealed 80.8% iden- 
tical classification for the 874 client re- 
sponses. The results of similar analy- 
sis by particular categories are shown 
in Table I. Thus of the three signifi- 
cant categories, positive and negative 
self-references were identified with 
much more certainty than were ambiv- 
alent responses. 


TABLE I 
PERCENT OF AGREEMENT WHEN 874 RESPONSES 
WERE RECLASSIFIED AFTER A 6 MONTH 
INTERVAL. ONE JUDGE 








Category 


P N Av A Oo Q 





% Agreement 


An interview-by-interview chi-square 
analysis of the differences between the 
two classifications by the writer indi- 
cated that probably all such differences 
in category totals could be attributed 
to chance factors. Chi-square values 
for the differences were all less than 
those required at the .05 level. 

The same methods of studying reli- 
ability were used with the data ob- 
tained from four judges all of whom 
classified the same four selected inter- 
views. All judges were graduate stu- 
dents in clinical psychology who were 


Both cases have been published in toto and 
can be found in references [6] and [7]. 
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given carefully detailed written instruc- 
tions plus a one hour conference period 
before they independently classified all 
client responses in the four interviews. 
The four interviews were selected as 
follows: two were believed easy and 
two were believed hard to classify; two 
were from successful cases, two from 
unsuccessful; three were from cases 
counseled somewhat nondirectively, one 
from a case of very directive counsel- 
ing; two were first interviews, one was 
a second contact, one was a fourth and 
penultimate interview; two of the in- 
terviews were conducted by the same 
counselor. A total of 356 client re- 
sponses were classified by the four 
judges. 

Analysis of the classification by the 
four judges revealed results very simi- 
lar to those obtained by the writer with 
a six month interval between classifi- 
cations. With agreement between three 
of the four judges as a criterion, 81.8% 
of all client responses were classified 
“correctly” by three of the four judges. 
As in the analysis of particular cate- 
gories by the writer, the judges found 
P and N responses fairly easy to detect 
while Av was more difficult to detect 
with certainty. Table II presents the 
percentage results for each category. 
Chi-square analysis of the differences 
between judges for each of the four in- 
terviews revealed that for one of the 


TABLE II 
PERCENT OF AGREEMENT (3 oF 4 JUDGES) WHEN 
356 CLIENT RESPONSES WERE CLASSI- 
FIED BY FourR JUDGES 


Category 


P N Av A Oo Q 








% Agreement .... 62.6 82.0 60.5 75.0 63.7 81.0 





interviews chi-square had a value great- 
er than that required at the .05 level 
indicating that there is much probabil- 
ity that for one of the four interviews 
the difference between judges is no 
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accident. 


While complete agreement on classi- 
fication of responses was neither ex- 
pected nor obtained, the reliability 
studies indicate that the method can be 
applied to verbatim responses of clients 
with considerable hope of gaining an 
objective picture of changes taking 
place in verbalized self-references. 

Validity of the Method. The results 
of two long cases were compared with 
the independent analyses of the same 
cases by their respective counselors. In 
his published account of the case of 
“Herbert Bryan”, Rogers [6] lists at 
the end of each verbatim interview “the 
outstanding attitudes which have been 
spontaneously expressed” by the client. 
He also gives brief subjective descrip- 
tions of what happened during the in- 
terview. The “outstanding attitudes 
expressed” apparently were selected 
without reference to such a notion as 
the Self-Concept or self-approving atti- 
tudes as defined in this study. His list 
of attitudes were classified according to 
the present method and the results com- 
pared with the results obtained by clas- 
sifying the verbatim material for the 
eight interviews of the case. Some dif- 
ferences were found, but in general a 
high degree of correspondence was not- 
ed. Table III illustrates the correspon- 


TABLE III 
COMPARISON OF RESULTS OF APPLYING THE 
METHOD TO ROGERS’ “OUTSTANDING ATTI- 
TUDES” OF INTERVIEW 2 (BRYAN) WITH 
THE METHOD APPLIED TO VER- 
BATIM INTERVIEW 


Total 
No. of 


Items %P %N %Av Total % 


Rogers’ list ............ 15 
Verbatim ............... 43 








20.0 
16.2 


73.5 6.5 
69.8 14.0 


100.0 
100.0 





dence found in a typical interview. Chi- 
square was applied to the differences 
obtained by the two methods for each 
interview. The Probability (From Fish- 
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er’s Table of P) was found to lie be- 
tween .80 and .90 indicating that the 
differences were primarily due to 
chance. 

The second attempt to ascertain va- 
lidity was a comparison of results for 
seven interviews of the case of “Al- 
fred” with the results of a different 
method of interview analysis made by 
the counselor, Father Charles Curran, 
and reported completely in his book, 
[3]. The results of this comparison re- 
vealed that in the seven interviews ana- 
lyzed by both methods, where marked 
changes in an interview were revealed 
by one method, similar marked shifts 
in results were obtained by the other 
method. 

When such attempts to seek validity 
for a method of analysis are attempted, 
one can not expect to emerge with hard 
and fast conclusions. Nonetheless, the 
results of the comparisons are suflici- 
ently encouraging to indicate that a 
quantitative analysis of client state- 
ments contains distinct possibilities for 
unraveling the complexities of basic 
personality dimensions. Curran’s [3] 
intensive analysis of a single counseling 
case and Baldwin’s [2] approach to the 
same problem using personal documents 
reveal the tedious but fruitful possibil- 
ities of the quantitative approach to 
verbatim verbal output. 

Application of the Method to 14 
cases. In order to explore the possibil- 
ities of the method, all responses in all 
interviews of 14 selected and completed 
counseling cases were classified by the 
writer. The clients were primarily re- 
ferrals to a psychological clinic con- 
ducted for college students. The num- 
ber of interviews ranged between 2 and 
21 per case, the median being 7 inter- 
views. The criteria of selection were as 
follows: 


1. All should involve primarily the counsel- 
ing of students with personal problems 
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rather than cases originating in vocation- 
al or educational problems. 


2. Different counselors should be represent- 
ed. (There were 11 different counselors.) 


8. Some should represent nondirective, oth- 
ers should represent directive counseling. 
(This criterion was met as only three 
were nondirective, one was clearly direc- 
tive and the remainder represented blends 
of the two methods.) 

4. Unsuccessful as well as successful cases 
should be included. (See below) 

5. Verbatim recordings should be available 
for all interviews of all cases. (This cri- 
terion was approached closely although 24 
of the 111 interviews were recorded by 
counselor notes, some of which were con- 
densations with an unknown number of 
client words omitted.) 

6. Each case should contain all interviews 
held between first and last contact. (Only 
one interview in a case of 8 contacts was 
unobtainable. One half of another inter- 
view was lacking because of recording dif- 
ficulties. ) 


The judgment of “success of the 
counseling” was made prior to the de- 
velopment of the method of analysis 
and was based upon clinical appraisal 
by the counselor involved, the professor 
of clinical psychology under whose di- 
rection most of the cases had been coun- 
seled, and the writer. Some follow-up 
data was available for four of the group 
judged successful and for three of the 
group judged unsuccessful. The cri- 
teria of success included reports of ac- 
tually changed behavior and social re- 
lationships where follow-up was avail- 
able as well as client expressions of sat- 
isfaction with the counseling at the 
conclusion of contact. Included in the 
successful group were several clients 
who referred friends or relatives to the 
same counselor although this was not 
used as a criterion of successful coun- 
seling. For the unsuccessful group, 
judgment was based upon follow-up 
data showing presence of the same 
problem, failure to return for another 
interview and obvious dissatisfaction 
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with the progress of counseling during 
the final interview. Two cases repre- 
sented questionable successes leaving 
five unsuccessful cases and seven judged 
successful. 

Results of the Method Applied to 14 
Cases. In view of the small number of 
cases available for analysis, conclusions 
resulting from the application of the 
method must be regarded as tentative. 
Elaborate statistics were avoided since 
there were only five unsuccessful cases 
and seven clearly successful cases. 
Nonetheless, all results obtained seemed 
to fit the original hypothesis that in 
successful counseling cases there is a 
shift in self-evaluation from an origi- 
nal preponderance of disapproval to a 
preponderance of self-approval at the 
end of counseling. In unsuccessful 
cases such a shift was not found. 

One of the most striking indications 
of this finding is obtained by examin- 
ing the graphs constructed for -each 
case based upon the interview by inter- 
view plotting of the relative frequency 
of the responses classified in the P, N, 
and Av categories. Percentages rather 
than raw scores were used in order to 
eliminate fluctuations due to the total 
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number of responses varying from in- 
terview to interview. Only two illus- 
trative graphs are presented here 
(Fig. 1). 

The principal characteristics of suc- 
cessful and unsuccessful cases are ex- 
emplified in Fig. 1. The progression of 
Percent P shows a decline from the 
first to the second interview in both 
successful and unsuccessful cases, while 
percent N tends to rise in both groups. 
This inverse relationship can probably 
be explained in terms of the dropping 
away of some of the client’s initial de- 
fensiveness. As contacts continue, there 
are wide fluctuations in both Percent P 
and Percent N with P tending to rise 
and N to decline. Percent of ambiva- 
lence rises for both groups (probably 
indicating increased uncertainty) but 
disappears, in the successful cases only, 
near the end of counseling. Concluding 
contacts show P rising to almost 100 per 
cent in the final interview in the success 
group, while N declines to the vanishing 
point. In the unsuccessful cases P nev- 
er exceeds in any interview a combined 
N and Av. In accordance with expecta- 
tions aroused by inspection of the 
graphs for all cases, a comparison of 
the gross frequency of each of the six 
categories revealed that the P category 
was the only one which distinguished 
between successful and unsuccessful ca- 
ses. 

Gross frequency, however, was com- 
puted on the basis of all interviews 
combined which prohibits analysis of 
the changes occurring from beginning 
to end of counseling. In order to ex- 
amine temporal changes, straight line 
curves were constucted from the raw 
scores of the P, N and AV categories 
using the Method of Least Squares. It 
was not supposed that Self-Concept re- 
organization could be accurately repre- 
sented by means of a straight line deri- 
ved for the purpose of minimizing inter- 
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interview fluctuations. Nonetheless, an 
inspection of these graphs does show 
that such straight lines do differentiaie 
between the successful and unsuccessful 
cases. In all but one of the seven suc- 
cessful cases the line of P rises to in- 
tersect and emerge at the final contact 
above the lines of N and Av. The one 
case in which P did not cross above N 
had 21 interviews in which the person- 
al problems seemed to be solved at the 
11th interview and the counseling from 
then on resembled a_ student-faculty 
member relationship. In none of the 5 
unsuccessful cases did the straight line 
of P cross above or even rise to meet 
the N and Av lines. Despite the ap- 
parent differences between the two 
groups, no statistical reliability for the 
slopes of any curve in either group was 
found when Fisher’s “t” was applied 
as a test of significance and .05 was 
made the fiducial limit. A trend toward 
reliability was found in the successful 
cases which was not approached by the 
unsuccessful group. Thus we are dealing 
with trends and since there are few 
grounds for believing that the change 
in self-approval can be represented by 
a straight line function the statistical 
measures used may obscure rather than 
clarify the facts. 

A further study was made of longi- 
tudinal changes in each case by cumu- 
lating raw scores of P and dividing by 
cumulated N at the end of each inter- 
view. Inspection of these quotients af- 
ter graphing them revealed that the .50 
level was reached by all of the successful 
cases by the end of counseling. (One 
case in this group had a final ratio of 


.49). Of the unsuccessful groups, one case 


showed an initial ratio starting above 
the .50 level, never dropping to that 
level in four interviews. This client, in- 
terestingly enough, was the only one in 
the group of fourteen who expressed 
any resentment against initiating coun- 
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seling and was the only one who would 
be considered a nonvoluntary referral. 
Of the other four unsuccessful cases, on- 
ly one had a ratio as high as .33 at any 
time. The finding that in successful cases 
cumulative P divided by cumulative N 
reaches the .50 level by the end of coun- 
seling (which is not approached by any 
of the unsuccessful cases) seems to be 
artifactual insofar as its usefulness for 
prediction is concerned. There is no 
plausible reason to believe that before 
a case is successfully concluded the cli- 
ent must express at least half as many 
positive self-references as negative self- 
references. Nonetheless, the technique 
of the cumulative ratio opens interest- 
ing possibilities for further analysis of 
data obtained by this method. 

Another index, called the “Av ratio” 
was computed by finding the percentage 
which the Ambivalent category forms 
of the total of the three significant cate- 
gories, P, N and Av. Analysis of this 
ratio for each case indicates that it may 
differentiate between clients who are 
seriously concerned about themselves 
and enter counseling under consider- 
able tension from clients manifesting 
less personal disturbance. The hypoth- 
esis was generally upheld when the 
cases were ranked subjectively but 
there were inconsistencies in the mid- 
dle range. 

Discussion. The principal findings 
can be summarized very simply. At the 
beginning of counseling the clients dis- 
approved of and had ambivalent atti- 
tudes toward themselves. As counsel- 
ing progressed fluctuations in approval 
occurred with mounting ambivalence. 
At the conclusion of counseling the suc- 
cessful cases showed a vast predomi- 
nance of self-approval: the unsuccessful 
cases showed a predominance of self- 
disapproval and ambivalence. There is 
nothing startling about such conclu- 
sions and it is doubtful if anyone ex- 
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perienced in counseling would seriously 
deny that considerably increased “self- 
respect” is observed in the client who 
has been successfully “treated”. The 
significance of the finding that changes 
in “self-respect” can be objectively fol- 
lowed during counseling becomes a cru- 
cial matter. A devotee of “dynamic 
tensions” might be justified in regard- 
ing the present findings as superfluous 
if not amusing. Interpretation thus be- 
comes a matter of relating the findings 
to one’s frame of reference where per- 
sonality organization is concerned. The 
crucial question becomes, When dealing 
with self-evaluations as defined in this 
study are we dealing with epiphenome- 
na or with indicators of more funda- 
mental changes? 

Psychological events are rarely con- 
sidered to be epiphenomenal. Even the 
strict behaviorist of twenty years ago 
rejected the data of immediate experi- 
ence because of its unreliability rather 
than because of its nonexistence. The 
issue is one of the ultimate significance 
which can legitimately be inferred from 
subjective report for the understanding 
of the behavior in question. The find- 
ings of the present study can be regard- 
ed as contributing only fragmentary or 
biased insight into personality changes 
but the findings can not be dismissed as 
“mere superficial descriptions of feel- 
ing.” It would indeed be a_sorry sys- 
tem of psychodynamics which dis- 
missed “feelings” (which are probably 
self-judgments, for the most part) from 
the realm of psychological significance. 

The conclusion which can be drawn 
from the present findings, and the in- 
terpretation which would be in line 
with self-concept theory, is essentially 
the hypothesis that changes in self-ap- 
proval are indicative of changes taking 
place in personality although the ob- 
served changes may not be direct meas- 
ures of the fundamental changes them- 
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selves. Violent fluctuations in self-ap- 
proval such as those occurring at the 
onset of a frank psychotic episode have 
not been studied quantitatively and 
need not contradict the present hy- 
pothesis in view of their bizarre set- 
ting. In some instances they probably 
corroborate the general hypothesis. 

It is believed that intimate knowl- 
edge of self-perceptions or their orga- 
nized totality, the Self-Concept, may 
well be one of the major pathways to 
detecting changes in personality if ob- 
jective methods of study can be devel- 
oped. The self-perceptions may not re- 
veal the fundamental nature of the 
changes taking place nor the exact 
means by which the changes occur. An 
analogy might be drawn to the use of 
the thermometer for observing changes 
in temperature. The change in eleva- 
tion of the column of mercury gives no 
direct knowledge to the observer of the 
altered velocities of the molecules sur- 
rounding the thermometer nor of the 
conditions which produce the altered 
velocities. Yet the thermometer can be 
used as a stable probe body for study- 
ing the conditions under which changes 
in molecular velocity can be brought 
about. 

The fact that the present method of 
following changes in self-approval is 
relatively reliable and objective lends 
further hope for its usefulness as a 
probe body. Much work remains to be 
done before its ultimate usefulness can 
be determined. Yet it is suspected by 
the writer and to some degree con- 
firmed by the present study that coun- 
selors or psychotherapists may well 
nave been using a similar technique on 
an intuitive level in diagnosing and 
judging the progress of their clients 
and patients. 

A final question. Can not the present 
research be viewed simply as indicating 


changes occurring in attitudes towards 


oneself without dragging in the Self- 
Concept? Perhaps. The answer depends 
upon how one views attitudes. As 
atomistically conceived, attitudes may 
be tabulated as entities in themselves. 
Present theory seems to demand, how- 
ever, a more complex and higher order 
construct to account for the functional 
interrelationships of attitudes. This de- 
mand accounts, in part, for the inclu- 
sion of the Self-Concept as an explana- 
tory principle in personality organiza- 
tion. 

Summary. In the analysis of person- 
ality changes occurring in counseling 
and psychotherapy it is necessary to 
find constructs which can be investigat- 
ed with the usual safeguards of objec- 
tivity and reliability. The events occur- 
ring in the interview provide a logical 
focus for such research. The verbal 
aspects of the interview are mainly 
concerned with the client’s discussion 
of himself. It is postulated that a per- 
son’s Self-Concept is a significant fac- 
tor in his behavior and personality or- 
ganization. By measuring changes 
which occur in clients’ attitudes toward 
themselves, it is believed that changes 


in Self-Concept and therefore in per- 
sonality organization can be detected. 


The present study used a six category 
check list to classify all client state- 
ments in terms of self-reference with 
three significant categories relating to 
approval, disapproval and ambivalence. 
Objectivity and reliability of the cate- 
gories were determined statistically. 


Validity was investigated by comparing 


results of the method with independent 
analyses of two counseling cases by two 
lifferer ethods of analvsis. 

When the present method was ap- 

‘teen counseling cases f 

ic! were almost verbatim re- 
cordings of the 11] ‘ v cons he 
ent diffe s were discovered between 
cases judged to have been counseled 
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successfully and those resulting unsuc- 
cessfully. In the successful cases there 
was a marked shift from a preponder- 
ance of self-disapproval and ambiva- 
lence at the beginning of counseling to 
a strong emphasis on self-approval at 
the conclusion of contact. This shift in 
self-evaluation was not found in unsuc- 
cessfully counseled clients. The results 
are interpreted as being in accord with 
the hypothesis that successful counsel- 
ing involves essentially a change in the 
client’s Self-Concept. 
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SUBTLE AND OBVIOUS KEYS FOR THE MINNESOTA 
MULTIPHASIC PERSONALITY INVENTORY 


By DANIEL N. WIENER 


VETERANS ADMINISTRATION, MINNEAPOLIS, 


N A recent article [4], Meehl and 

Hathaway described the need for 
and the development of a scale to indi- 
cate test-taking attitudes and their ef- 
fect upon scores obtained on structured 
personality inventories. Their conclu- 
sions were that there was a conscious 
or unconscious tendency of subjects to 
present a picture of themselves that has 
a considerable influence upon their per- 
sonality test scores; that this tendency 
might be to place them in an overly fa- 
vorable or unfavorable light; and that 
the present “validity” scales of the 
Minnesota Multiphasic Personality In- 
ventory did not seem to be sufficiently 
subtle to detect this test-taking atti- 
tude. They developed a K scale for the 
Inventory to detect the influence of 
these test-taking attitudes and to im- 
prove the discrimination of the test be- 
tween normal and abnormal popula- 
tions [2]. 

While the K scale was being consid- 
ered and developed, colleagues and the 
present author were developing the 
concept of relatively subtle and obvious 
keys for the scales of the Minnesota 
Multiphasic Personality Inventory on 
the same grounds as those given by 
Meehl and Hathaway. It was felt that 
the development of such keys on indi- 
vidual scales of the MMPI would yield 
more information and be of more prac- 
tical usefulness than an overall valid- 


‘ 


1'Views expressed are the responsibility of 
the author only, although Dr. L. R. Harmon 
and Dr. S. R. Hathaway contributed valuable 
information. 
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ity scale, such as L, N, G, and finally 
K, developed by Hathaway and Meehl. 

The main problem of the counselor 
working with a relatively normal popu- 
lation in a broad counseling situation, 
as differentiated from the clinical psy- 
chologist working with a seriously dis- 
turbed group, is to distinguish nondis- 
abling personality factors that charac- 
terize counselees as do aptitude and in- 
terest test results. The seriously dis- 
turbed group can probably be distin- 
guished by a test consisting of items ob- 
viously indicating deviate personality 
characteristics, since the extreme devi- 
ates are probably largely unaware of 
the significance of their symptoms and 
are usually frank in their test answers. 
Screening devices developed for the 
military services and for private indus- 
try which consist largely and obviously 
of deviate items, probably owe their 
success to this fact. 

Extremely deviate individuals can be 
picked out by a test consisting of obvi- 
ous items. To help the counselor work- 
ing with a normal population, however, 
a-much more subtle test is required 
which will both distinguish the extreme 
deviates and will differentiate among 
the characteristics of a normal popu- 
lation. These two services of a person- 
ality test appeared to be best served by 
developing both subtle and obvious keys. 


METHOD 


In the experimental development of 
subtle and obvious keys for a person- 
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ality test, the Minnesota Multiphasic 
Personality Inventory was used because 
it was available for a large relatively 
normal population, because it was felt 
to have the most extensive and useful 
validation of any personality test, and 
because it uses generally accepted 
categories of personality characteris- 
tics. In addition it had the unique fea- 
ture of validity measures designed to 
indicate, on a limited basis, test-taking 
attitudes. After using it extensively, 
however, it was felt that when it was 
used with a relatively normal popula- 
tion, one that was functioning relative- 
ly successfully in society, certain im- 
portant aspects of personality were 
masked because of its validation in 
terms of abnormal groups. The most 
obvious items distinguished these ab- 
normal groups from the normal, where- 
as it appears that the more subtle items 
should have the greater validity in dis- 
tinguishing the personality character- 
istics of normal groups. 

To develop subtle and obvious keys, 
Harmon and the present author divided 
all items of the MMPI into two groups, 
those to which significant responses 
were relatively easy to detect as indi- 
cating emotional disturbance, and those 
to which they were relatively difficult 
to detect. Using several criteria, the 
items for each scale were sorted into 
these two categories. All F scale items 
that also appeared in other scales were 
automatically assigned to the “obvious” 
category because by definition they sel- 
dom occur in a normal population. In 
addition, those items for which a blank 
response (no check on the answer 
sheet) was scored in a significant direc- 
tion, were assigned to the subtle keys. 
Pooled judgments of the raters was 
then used to sort the other items into 
the two categories with no attempt 
made to equalize the number of items 
in each group. There were more obvi- 
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ous items than subtle. The keys thus 
developed were used to rescore the test 
sheets of a representative sampling of 
100 cases of the original male norm 
group for the MMPI. T-scores were de- 
veloped and assigned to subtle and ob- 
vious item counts on the same basis as 
for the total scale T-scores. 

Tabulation tables for the raw scores 
on the subtle and obvious keys (here- 
after referred to as S and O) indicated 
a positive skew for most of the O-item 
distributions of the norm group; rela- 
tively few individuals in the normal 
population answered the obvious items 
in a significant direction. It seemed 
probable that significant answers to 
these O items were most characteristic 
of an institutionalized population. The 
S items were distributed in a relatively 
normal manner. 

An additional check on the validity 
of the selection of items for the keys 
was the frequency of their occurrence 
among the responses of a normal popu- 
lation. Frequencies of responses in a 
significant direction to items of the O 
and S keys for five MMPI scales are 


indicated in Table I for 139 normal 


TABLE I 
AVERAGE FREQUENCIES OF SIGNIFICANT 
SPONSES IN NORMAL MALE POPULATION 
TO ITEMS IN SUBTLE AND OBVIOUS 
KEYS OF THE MMPI 


RE- 


Responses per 100 cases 


Scale Obvious Subtle 
. i <.; Tee 48 
Hy . WB 41 
Pd 20 28 
Pa . . 10 32 
Ma .... = 23 38 
Mean Seca 17 39 


Minnesota males (from unpublished 
data by Hathaway). For all five scales 
the S items were answered in a signifi- 
cant. direction approximately twice or 
more as frequently as the O items. In 
addition, for 65 of the 110 items in the 
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S keys for these five scales, the “sig- 
nificant” direction for scoring reversed 
the expectation of Hathaway and Mc- 
Kinley when they included these items 
in the MMPI, whereas only 8 out of the 
146 O items scored in a reverse direc- 
tion from the original authors’ expec- 
tation. 

It can thus be seen that the bases 
used to select items for the S and O 
keys for five scales of the MMPI yield- 
ed O items which were answered rela- 
tively infrequently in a significant di- 
rection by a normal population com- 
pared with S items, and S items whose 
significant answers were in a reverse 
direction from the expectation of both 
the original authors of the MMPI and 
of the authors of the present keys. 

The attempt was originally made to 
develop S and O keys for all scales of 
the MMPI, but the results for Sc, Pt, 
Mf, and Hs, were almost uniformly 
negative. Hs consisted almost entirely 
of obvious items. Pt and Sc by defini- 
tion also consisted of extremely deviate 
items which were therefore obvious, 
and Mf probably has too low validity 
as a scale to yield positive results. 


TABLE II 
CORRELATIONS BETWEEN OBVIOUS AND SUBTLE 
KEYs OF THE MMPI 


D- D- Hy- Hy-Pd- Pd- Pa- Pa- Ma- 
_ © F&F 68 8 & &@ BS 2 OO 


D-O a 


D.S............. .06 —.20 

Hy-O..... 88 .78 -—.24 

Hy-S....... 45 -.48 .51 -—.46 

Peta. £1 48-58 41-58 

Pd-S....... 09 -.05 .19 .29 .36 .04 

Pa-O..... 48 .61 -.07 .58 —.21 .64 .08 
a 21 -.18 .45 -.14 .59 -.12 .14 .10 
Ma-O.......... .41 .51-.11 .45 -.68 .61-.14 .56 -.29 
Ma-S 18 -.26 -—.17 -—.10 


06 .22 .22 .19 -.17 .24 


CORRELATIONS AMONG SUBTLE AND OB- 
VIOUS KEYS, HS, AND K 


Table II indicates the intercorrela- 
tions among S and O keys, and correla- 
tions with Hs which is really an O 
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scale. In general, these intercorrela- 
tions show the O keys highly correlated 
with each other positively, and uncorre- 
lated with the S keys; while the S keys 
show low positive correlations with 
each other. Considered only as a rough 
index of relationship, the average inter- 
correlation among the O keys is +.60, 
the average correlation of the O with 
the S keys is —.15, and the average in- 
tercorrelation among the S keys is 
+21. 

Correlations between O minus § 
scores and the K scale of the MMPI are 
shown in Table III. The uniformly high 


TABLE Ill 
CORRELATIONS BETWEEN OBVIOUS MINUS 
SUBTLE KEYS AND K SCALE 

OF THE MMPI 
(N = 152) 
Pd. 
2 Pa 
Ma —.47 


aw G4 
—= 00 


negative correlations that exist suggest 
the strong appearance of a test-taking 
attitude in each of the five scales, and 


the close relationship between S re- 
sponses and the K score. 
RELATIONSHIPS WITH “LIE” SCORES, 


ABILITY, PSYCHOLOGICAL SOPHISTI- 
CATION, AND NEUROPSYCHIA- 
TRIC DIAGNOSIS 


Table IV suggests relationships be- 
tween S and O, and the “Lie” scale, in- 
telligence, psychological sophistication, 
and neuropsychiatric diagnosis. These 
studies are meant only to suggest cer- 
tain relationships and have not been 
subjected to rigid statistical analysis. 
The group with high scores on the 
“Lie” scale (9 items plus) of the MMPI 
was higher on the S keys of all five 
scales than on the O keys, and was also, 
in four cases out of five, higher on the 
S keys than was the low “Lie” (0 and 
1 items) scale group. For the group 
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TABLE IV 
MEANS AND MEDIANS OF VARIOUS GROUPS ON SUBTLE-OBVIOUS KEYS OF THE MINNESOTA 
MULTIPHASIC PERSONALITY INVENTORY 
(S and O in T-scores) 








Group N _s Criteria D Hy Pd Pa Ma 
= ww 0 al “as &@e £8 68 8 
eae PD 45 9“L” items + ....... 5764 5767 4760 4657 4653 
gg ee eae 50 0&1 “L” items. 61 42 58 50 56 52 48 51 57 58 
High Ability... 40 Intell. SS 60+, 


some college ..... 


Low Ability ...................... 29 Intell. SS 40—, 


plus 9th grade— 


Psy Sophis “(Honest)*.... 58 A 
Fall 1943 
Psy Sophis (Fake Good)* 53 Same 


No. Diag—High Mult*... 12 





above 70 
NP Diag.—High Mult*.... 12 Same 


*Median scores; all others are means. 


with low “Lie” scores, the 0 scores were 
for all scales approximately equal to or 
higher than the §S scores. 

Individuals of high ability (intelli- 
gence T-score above 60 on Unit Scales 
of Aptitudes or Otis S-A Test, and some 
college work) have approximately equal 
O and § scores, whereas individuals of 
low ability (T-score below 40, and less 
than 9th grade education) have gener- 
ally higher O scores than S, and higher 
O scores than the high ability group. 

MMPI profiles of a psychologically 
sophisticated group, as indicated by 
study in the ASTP psychology training 
program, showed clear-cut distinction 
between S and O keys, with S much 
higher than O whether the group was 
giving “honest” results or was attempt- 
ing to “fake good.” With this psycho- 
logically sophisticated group it appeared 
to make little difference whether the 
test was taken “honestly” or “faked 
good”; in either case, O items were suc- 
cessfully avoided, whereas S_ items 
yielded average and above average T- 
scores. Very few O items were ans- 


ASTP students .. 


One + T scores . 


40 58 42 64 42 56 9 54 12 58 
37 61 41 64 40 58 39 60 44 62 
69 48 54 51 63 56 5 / 56 58 
69 52 76 49 56 52 2 56 66 51 


wered in a significant direction; the 
raw-score mean for the group was ap- 
proximately 2.5 on D-O, 1.0 on Hy-O, 
2.5 on Pd-O, 0 on Pa-O, and 3.5 on 
Ma-O. 

Generalizing from a very limited 
number of cases, there is a possibility 
that individuals without neuropsychia- 
tric diagnoses but with high MMPI pro- 
files (one or more T-scores above 70) 
are somewhat higher than on the 8S 
keys and somewhat lower on the O keys 
than a group with neuropsychiatric 
diagnoses and with high MMPI 
files. 


pro- 


S-O DIFFERENCES BETWEEN SUCCESSFUL 
AND UNSUCCESSFUL STUDENTS 
AND TRAINEES 

The practical significance of the S 
and O keys was tested by their applica- 
tion to the MMPI answer sheets of 
groups of successful and unsuccessful 
veterans in school and in on-the-job 
training. These veterans had previous- 
ly been studied to determine what fac- 
tors in the counseling procedures differ- 
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entiated between success and failure in 
training. Very few tests or case history 
factors did differentiate for any voca- 
tional groups; the MMPI showed con- 
sistent but generally insignificant dif- 
ferences favoring the emotional stabil- 
ity of the successful group. General- 


TABLE V 
SIGNIFICANCE OF DIFFERENCES BETWEEN SUC- 
CESSFUL AND UNSUCCESSFUL GROUPS ON 
SUBTLE, OBVIOUS, AND TOTAL SCALES 
OF THE MMPI 
(N = 50 each for S and U groups) 











(S = Successful; U — Unsuccessful) 
pcinia hx Mean ; SEx CR. 
S D-O 54.00 13.75 1.94 
U D-O __ 62.40 18.85 2.67 2.55** 
S-D-S 51.50 10.55 1.49 
U D-S__—50.50 10.75 152 — .47 
S D-T 54.40 12.65 1.75 
U D-T 60.50 16.70 2.36 2.07** 
S Hy-O 55.20 12.05 1.70 
U Hy-—O 62.80 14.85 2.10 z21°° 
S Hy-S_ 55.20 8.75 1.24 
U Hy-S_ 52.70 8.95 127 —1.41 
S Hy-T 56.50 10.35 1.46 
U Hy-T 58.50 12.50 1.77 87 
S Pd-O 50.40 11.10 1.57 
U Pd-O 55.50 10.25 1.45 2.39** 
S Pd-S 54.00 8.75 1.24 
U Pd-S'_ 52.40 10.35 1.46 — .84 
S Pd-T 51.90 10.60 1.50 
U Pd-T 55.20 11.80 1.67 1.47 
S Pa-O 47.00 11.55 1.63 
U Pa-O 53.30 13.70 1.94 2.49** 
S Pa-S 54.00 8.30 1.37 
U Pa-S_ 51.40 12.15 1.72 —1.26 
S Pa-T 50.90 8.80 1.24 
U Pa-T 52.80 11.65 1.65 92 
S Ma-O 51.50 12.05 La 
U Ma-O 56.90 13.10 1.85 2.15** 
S Ma-S_ 55.90 11.35 1.61 
U Ma-S_ 55.50 9.05 1.28 — .20 
S Ma-T 55.40 10.45 1.48 
U Ma-T 58.90 11.30 1.60 


1.61 





*Significant at 5% level. 
**Significant at 1% level. 
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ly, success was defined as having been 
in school or on-the-job training success- 
fully for six months or more and still 
being there at the time of the study, 
whereas failure was defined as having 
left school or on-the-job training prior 
to completion. 

The results of S and O as well as of 
the total scores were studied for 50 suc- 
cessful and 50 unsuccessful cases chos- 
en at random. Table V indicates the 
results. The O keys in all cases showed 
a significantly higher score for the un- 
successful as compared with the suc- 
cessful group, the S keys indicated in- 
significantly higher results for the suc- 
cessful group, and total scale results 
yielded differences in between the re- 
sults of O and §S keys, insignificantly 
(with one exception) favoring emo- 
tional stability in the successful group. 

In most counseling situations where 
work is done with a relative normal 
population, it is probable that the pres- 
ent MMPI total scale scores will largely 
fail to differentiate between successful 
and unsuccessful counselees because the 
total score represents a compromise be- 
tween two fairly well differentiated as- 
pects of each scale. Apparently eleva- 
tion on the S keys tends to indicate, or 
at least does not counter-indicate, suc- 
cess in school or on-the-job training. 
Conversely, elevation on the O keys 
tends to predict failure. Results of to- 
tal scale scores alone obscure this dif- 
ference in function of S and O items in 
the MMPI. 


SUMMARY AND CONCLUSIONS 


1. New scales are needed for person- 
ality tests to indicate test-taking atti- 
tudes which might place the counselee 
in an overly favorable or unfavorable 
light. 

2. Items in personality tests may be 
considered on a continuum from obvi- 
ousness to subtlety. The O items differ- 
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entiate best between abnormal and rela- 
tively normal groups; S items probably 
work best in measuring the personality 
characteristics of normal individuals. 

3. Counselors working with a normal 
population would be served best by a 
personality test performing both as a 
screen for extreme deviates and as an 
indicator of personality characteristics 
of norma! individuals. 

4. S and O keys for the MMPI were 
developed for five scales of the MMPI, 
D, Hy, Pd, Pa, and Ma. T-scores were 
developed from a sampling of the origi- 
nal male norm group of the Inventory. 

5. In general, O keys are highly cor- 
related with each other and have no 
correlation with S keys; S keys have a 
low positive correlation with each oth- 
er. There is a high negative correlation 
between O minus § and K, indicating 
the considerable weighting of K with 
S items. 

6. There is some very limited evi- 
dence that high “Lie” scale scores are 
associated with higher S than O scores, 
whereas the converse is true for low 
“Lie” scores; that individuals of high 
ability have equal O and § scores, while 
those of low ability have higher O than 
S scores; that psychologically sophisti- 
cated individuals almost completely 
avoid significant O responses and have 
much higher S scores; that high MMPI 
profiles without neuropsychiatric diag- 
noses show higher S scores and lower 
O scores than high profiles with neuro- 
psychiatric diagnoses. 

7. While total scale scores on the 
MMPI failed to differentiate signifi- 
cantly between successful and unsuc- 
cessful students and on-the-job train- 
ees, O keys were significantly higher 
than the S for the unsuccessful group. 
The S keys were insignificantly lower, 
and the total scale scores were between 
the two. 


8. A word of caution: The S and O 


169 


keys are not presented in final form or 
for indiscriminate use. Their proper 
use is predicated upon the recognition 
by counselors that extensive prior ex- 
perience with and understanding of the 
MMPI is required. Furthermore, only 
subjective clinical observations indicate 
their significance on each of the five 
scales considered independently. How- 
ever the objective evidence indicates 
that the O and § scores are distributed, 
and associated with the factors studied, 
in an approximately similar manner 
for each of the scales. They seem to 
have the same meaning and to perform 
the same functions for each scale. 

9. It is probable that the use of S and 
O keys in counseling a relatively nor- 
mal population will increase appreci- 
ably the usefulness of the MMPI in 
predicting vocational and educational 
success as well as in distinguishing 
test-taking attitudes of importance in 
the therapeutic process. More specific 
statements regarding the significance 
of S and O keys for the MMPI will be 
possible upon the completion of further 
research into the validity of the origi- 
nal item selection method, the differen- 
tiating power of S and O keys among 
abnormal groups, and the predictive 
value of S and O for therapeutic suc- 
cess.’ 


2A limited number of lists of S and O items 
for each key and for all forms of the MMPI 
are available upon request to the author. 
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THE CLINICAL POSSIBILITIES OF AN ABBREVIATED 
INDIVIDUAL INTELLIGENCE TEST’ 
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KLEBANOFF, IVAN N. MENSH, AND MEYER WILLIAMS 


NORTHWESTERN UNIVERSITY 


F ABBREVIATED individual intel- 
ligence tests are to be used in clini- 
cal testing, they must serve not only as 
measures of intellectual level but as 
diagnostic indicators as well. One such 
short test, the CVS scale, whose valida- 
tion and standardization have been re- 
ported elsewhere [1, 2], has been de- 
signed with diagnostic possibilities in 
mind. It consists of two sub-tests, Com- 
prehension and Similarities from the 
Wechsler-Bellevue scale [5], which are 
relatively sensitive to psychopathosis, 
and one, a 15-word Vocabulary list pro- 
posed by Thorndike [4], which is rela- 
tively insensitive to psychopathosis. 
The discrepancy between performance 
level on Vocabulary and that on the 
other two tests offers a measure of 
“scatter” of the type that previously has 
proven valuable for clinical purposes. 
The present paper reports an experi- 
mental investigation of the clinical di- 
agnostic potentialities of the CVS scale. 
The experimental design of the in- 
vestigation was based upon the testing 


1This study is part of a larger project sub- 
sidized by the Office of Naval Research under 
its policy of encouraging basic research. The 
opinions expressed, however, are those of the 
individual authors and do not represent the 
opinions or policy of the Naval service. For 
their cooperation on various aspects of this 
study, our thanks are due to the staff of the 
Great Lakes Naval Training Station; Dr. Na- 
than W. Shock of the U. S. Public Health 
Service’s Gerontological Unit, and the staff of 
the Baltimore City Hospital; Dr. Phyllis Witt- 
man and the staff of the Elgin State Hospital; 
and Mr. William Sloan and the staff of the 
Lincoln State School and Colony. 


of four groups of subjects: 


1. A normal group not expected to show scat- 
ter 

2. A normal group expected to show scatter 

3. A clinical group not expected to show 
scatter, and 


4. A clinical group expected to show scatter. 


The normal group not expected to 
show scatter consisted of 196 naval re- 
cruits whose ages ranged from 17 to 
20 with a mean of 17.19. The mode was 
overwhelmingly at 17. The school grade 
completed ranged from 5 to 12 with a 
mean of 9.03 and a standard deviation 
of 1.50. The normal group expected to 
show scatter consisted of 103 elderly 
males whose ages ranged from 55 to 
88 with a mean of 67.10 and a standard 
deviation of 7.45. School grade com- 
pleted ran from 0 to 16 with a mean of 
5.45 and a standard deviation of 2.75. 
The clinical group not expected to show 
scatter was composed of 57 institution- 
alized feebleminded males. Their age 
range was from 17 to 26 with a mean 
of 19.79 and standard deviation of 2.42. 
Most had received no formal schooling. 
The clinical group expected to show 
scatter included 45 hospitalized schizo- 
phrenics. Only cases where there was 
staff agreement on the diagnosis were 
used. Age ranged from 16 to 43 with a 
mean of 27.29 and standard deviation 
of 5.67. School grade completed ranged 
from 7 to 15 with a mean of 10.16 and 
standard deviation of 2.47. 


All the subjects were given the CVS 
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TABLE I 
MEAN SCORES AND STANDARD DEVIATIONS FOR CVS 
196 Naval §  103Aged 57 Defect 45 Schiz 
Mean S.D. Mean S.D. Mean S.D. Mean S.D. 

| . 27.56 5.37 21.87* 7.48* 15.75* 4.96 23.82 13.36* 

+ RE 9.66 2.44 6.11* 3.31* 5.74* 1.77* 7.13* 4.13* 

iF pideaeeees 9.30 2.27 9.53 3.40* 5.08* 1.68* 9.75 3.92* 

i \eccmeckimedneds 8.78 2.57 5.35* 3.41* 5.18* hea” 7.83 3.88* 
*Indicates difference fem Mowry aneen . ww ‘@andaré ‘Qntation slaniiieant ot 1% haved 


individual intelligence scale. The test- 
ing was done by three experienced 
testers whose performance previously 
had been shown to be comparable [2]. 

Table I gives the mean scores and 
standard deviations of all four groups 
for the total CVS battery and for each 
of the three subtests. All scores report- 
ed are standard scores [1]. Where any 
group differs significantly (1% level of 
confidence) from the Navy mean or 
standard deviation, it is indicated in the 
table by an asterisk. The performances 
are in the expected directions with the 
predicted scatter revealed in the fact 
that, while the mean score for vocabu- 
lary is not significantly different from 
the Navy in either the aged or schizo- 
phrenic groups, the mean score for 
comprehension is significantly less for 
both schizophrenics and aged, and the 
mean for similarities less for the aged. 


TABLE II 
NUMBER AND PERCENT OF CASES HAVING COM- 
PREHENSION AND SIMILARITIES SCORES 
LESS THAN VOCABULARY SCORE 


C less Sless Both CandS 
than V than V__siless than V 
Group N % N % N / 
Navy 65 33 90 46 £37 19 
Aged 90 87 95 92 85 82 
Feeble- 
minded 21 37 21 37 11 19 
Schizo- 
phrenics ~~ @& s 69 28 62 


The scatter picture becomes clearer 
in Table II which shows the number of 


cases in each group in which the scores 
for comprehension, or similarities, or 
both, are less than the vocabulary 
score. We may summarize this table by 
saying that, if we accept a lower score 
on both comprehension and similarities 
than vocabulary as indicative of 
scatter, only 19 percent of either the 
Navy or feebleminded groups show 
scatter, whereas 62 per cent of the 
schizophrenic group and 82 percent of 
the aged group exhibit it. 

CVS thus seems to have diagnostic 
possibilities since it shows some sensi- 
tivity to “deterioration” through a 
measure of intertest scatter based on 
the discrepancy between vocabulary 
performance and that on comprehen- 
sion and similarities. If CVS were us- 
a screen test for schizophrenics, 
tion” and ‘ positive” 
ported above would compare fa- 
vorably with some of the screen tests 
used in the military services during the 
war [3]. 

Several measures of intratest scatter 
(variability in performance among the 
items within any single subtest) were 
also tried but were found to possess no 
diagnostic significance. This agrees 
with past experience as reported in the 
literature where such intratest meas- 
ures have consistently failed to be of 
value. 

In clinical practice, particularly 
within the military services, abbreviated 
scales were often used as screening de- 
) separate from any group being 


on 


ed as 
the “det false 


rates r 


vices ¢ 
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examined those subjects suspected of 
being mentally deficient and hence in 
need of further psychological examina- 
tion. For such a purpose, some test 
score is arbitrarily assumed as a “cut- 
ting point” and all subjects scoring be- 
low that point are selected for further 
study. To be of value as a screening 
test for mental deficients, an intelli- 
gence scale must thus differentiate 
fairly sharply between a normal and a 
feebleminded group. Table III shows 


TABLE III 
“CUT-OFF” ABILITY OF CVS 
(Cutting scores based on standardization group 
of 724 subjects) 


CVS less 


CVS less 
than 25 than 18 
(1 SD below (2 Sd below 
mean) mean) 
Group N % N % 
Feeble- 
minded 57 100 44 77 
Navy 
(196) 70 36 10 5 
Navy 
(724) 122 17 17 2 


the results when CVS is used in this 
fashion on our naval recruits and group 
of institutionalized mental deficients. 
As cutting points, scores 1 standard 
deviation and 2 standard deviations be- 
low the mean total standard score were 
used. The mean total standard score is 
not based on our group of 196 naval re- 
cruits, but is that reported elsewhere 
[1] for a group of 724 (which includes 
the present sampling of 196) naval re- 
cruits whose mean GCT (Navy General 
Classification Test) score was 49.20 
with a standard deviation of 11.90, and 
who therefore closely approximate a 
representative sampling of the popula- 
tion at large, since a score of 50 (stand- 
ard deviation equals 10) represents the 
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mean performance of the Naval popu- 
lation during wartime. The mean GCT 
of our group of 196 recruits was 45.70 
indicating that the group is a bit below 
the average in intelligence. In view of 
this, Table III also includes the “cut- 
ting” performance of CVS when used 
onthe larger, more representative group 
of 724 recruits. CVS thus shows prom- 
ise of satisfactory performance as a 
screen test for mental deficiency. 


In the case of CVS, then, the claim 
that abbreviated tests will not offer sat- 
isfactory diagnostic measures is not 
borne out. Our results indicate that it 
offers a valuable quantitative scatter 
measure based upon the discrepancy be- 
tween vocabulary score and the scores 
for comprehension and similarities. It 
also performs satisfactorily as a screen 
test for mental deficiency. In addition, 
it should be remembered that all three 
subtests also are rich in qualitative 
cues and were chosen because the na- 
ture of the subject’s performance on 
these tests offers the trained clinician 
a wealth of behavioral material for 
subjective clinical interpretation. 
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THE ROLE OF SELF-UNDERSTANDING IN THE 
PREDICTION OF BEHAVIOR 
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NUMBER of years ago a study in 
prediction of the behavior and 
adjustment of delinquent adolescents 
was made by Kell [3] under the super- 
vision of the senior author. The major 
finding of the study was so striking and 
so unexpected that the completed re- 
search was laid aside until it might 
be confirmed or disproved by addition- 
al work. Later Miss McNeil repeated 
the identical method of study on a new 
group of cases [4] with results which 
confirmed, though less strikingly, the 
same findings. It now appears appro- 
priate to present these two studies in 
somewhat condensed form, together 
with some of the implications which 
they seem to have for clinical practice 
and personality research. 


THE HYPOTHESIS 


The hypothesis was the same in both 
studies. It was that given sufficient in- 
formation concerning the factors which 
presumably enter into the determina- 
tion of an individual’s behavior, it 
should be possible to make ratings of 
these factors which would predict with 
some degree of accuracy the individu- 
al’s later adjustment. More specifically, 
given information regarding an indi- 
vidual’s heredity, physical condition, 
mental status, family environment, 
cultural background, social experience, 
educational experience, and self-insight, 
it should be possible to rate these fac- 
tors as to their favorableness for nor- 
mal development, and on the basis of 


these ratings, predict future adjust- 
ment. If behavior is caused by factors 
such as those listed, then an evaluation 
of such factors should provide a basis 
for estimating the type of behavioral 
adjustment which is likely to ensue. 


THE PLAN OF THE STUDIES 


The plan of both studies was identi- 
cal and contained the following general 
elements. 

1. To select a group of delinquent 
children for whom there was an ade- 
quate amount of diagnostic informa- 
tion, and follow-up reports of adjust- 
ment covering a period of approximate- 
ly two years following the initial study. 

2. To make ratings of the various 
factors which might determine behavior, 
by means of the so-called “(Component 
Factor Method” (described below), 
these ratings to be entirely on the ba- 
sis of information available at the time 
of the initial study, without any refer- 
ence to the follow-up data. 

3. To make independent ratings of 
the adjustment of the individual two 
years after the diagnostic study, these 
ratings to be made without reference 
to the information obtained in the diag- 
nostic evaluation. 

4. To analyze the material for pos- 
sible correlations between each compo- 
nent factor and later adjustment, also 
for correlations between all the factors 
taken together and later adjustment. 
To consider whether the behavior of 
these delinquents might have been in 
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any way predicted by this method, from 
the information available at the time of 
the initial study. 

The way in which these steps were 
carried out is presented in some detail 
in the sections which follow. 


THE SELECTION OF THE GROUPS 


The cases which were used in this 
study were obtained from the files of 
the Bureau of Juvenile Research, Co- 
lumbus, Ohio, and it was due to the 
wholehearted cooperation of this or- 
ganization that the research was pos- 
sible. The procedure was as follows. 
Mr. Kell went over a few cases to see 
whether the information contained in 
the case histories and in the follow-up 
files was adequate for the type of analy- 
sis which he wished to make. It ap- 
peared that in many cases the informa- 
tion was adequate for his purposes. 
None of these preliminary cases was 
used in the research. He then took 155 
cases which had been studied by the 
BJR after June 1937, and on which 
there was reported to be follow-up in- 
formation two to three years after the 
diagnostic study. Cases were selected 
at random except that there was some 
perusal of the follow-up reports to make 
sure that both failures and successes in 
adjustment were being included. This 
was the only contact with the follow-up 
reports prior to the specific study of the 
follow-up material reported later. 

When the Component Factor ratings 
were made on these 155 cases, it was 
found that the information was inade- 
quate in 71 cases, and these were 
dropped. In making the ratings on fol- 
low-up adjustment, information was 
found to be inadequate in 9 additional 
cases, thus bringing the total number 
included in the research to 75. It does 
not appear that lack of information in 
the case record would be a selective fac- 
tor related to the problems being stud- 


ied in this research. 


In the study made by Miss McNeil, 
141 cases were initially selected, the 
criteria being similar, with the added 
item that they should all be new cases 
which had not been utilized in the Kell 
study. She found it necessary to drop 
out 65 cases because of inadequate in- 
formation, thus leaving 76 individuals 
in her group. Thus in the two studies 
taken together there are 151 individ- 
uals on whom the reported findings are 
based. 


Certain general facts about the two 
groups are listed in Table I. 


TABLE I 
CHARACTERISTICS OF THE GROUPS INCLUDED IN 
THE KELL AND MCNEIL STUDIES 


Kell’s McNeil’s 
Group Group 
Average age at time 
of diagnostic study 15-2 14-6 
Range in age ........ 8-9 to 17-11 7-9 to 18-1 
Number of boys ...... 57 59 
Number of girls .... 18 17 
RUMI > so cccccsccenianncwns 65 66 
Negroes rele 10 10 
Average intelligence 
quotient .............. 94 90 
Range in I.Q............. 45 to 136 41 to 140 
From rural homes unknown 9 
From urban homes unknown 67 


In an analysis made of Miss McNeil’s 
group it was found that the behavior 
difficulties were those that we have 
come to regard as typical of a juvenile 
delinquent group — stealing, truancy 
from school and home, incorrigible be- 
havior, untruthfulness, and sex misde- 
meanors heading the list of complaints. 
There were 27 of the group who had 
previously been in court. Broken and 
discordant homes were the rule, and 
more than half of the group had had 
some foster home or institutional ex- 
perience away from their own home. In 
general it may be said that the adoles- 
cents included in the study appear to be 
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typical of individuals coming to a juve- 
nile court or behavior clinic. 


THE RATING OF COMPONENT FACTORS 


When the groups had been selected 
the next step was to rate those factors 
in the child’s background and experi- 
ence which might presumably be relat- 
ed to future behavior and adjustment. 
For this purpose the component factor 
method of case analysis, devised by 
Rogers and the staff of the Rochester 
Guidance Center, and described in an 
eariier publication [5, ch. 3] was used. 
Since the findings are in terms of the 
categories used in this device, some de- 
scription of it is given here, though for 
a full account of its development or its 
use in other research [3, 2], the reader 
is referred elsewhere. 

The rationale behind this method of 
rating and analysis, and a brief descrip- 
tion of the method, is given by Rogers 
in the following statement: 


Behavior problems are due to the fact that 
a child of certain hereditary equipment is 
dealt with in a certain manner by members 
of his family environment and at the same 
time affected by certain broader cultural and 
social influences. If any one of these elements 
is altered, the behavior picture is also altered. 
To understand behavior we must view it as 
the complex result of all these component fac- 
tors. Thus in the method under consideration, 
the forces which have operated in the child’s 
experience are grouped under eight factors, 
defined so far as possible in terms which will 
have general understanding. Each of these 
factors . . . is rated in the case of the indi- 
vidual child on a seven point scale, ranging 
from influences which are destructive to the 
child’s welfare, to conditions and forces ideal 
for the child’s adjustment. This rating scale 
is made more objective by means of sample 
ratings, with experimentally determined val- 
ues, set up as guideposts. [5, p. 40-41] 


The eight factors which are to be 
rated on the basis of material in the 
case history are defined in specific 
terms. For each factor there are also 
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a series of illustrative ratings, taken 
from cases, and showing the average 
scale value which was given to the ma- 
terial by six clinician judges. The defi- 
nitions to be kept in mind by the rater 
are stated below as given in the origi- 
nal description by Rogers, and as used 
by Kell and McNeil in these studies. In 
the interests of brevity the illustrative 
ratings have been omitted, except for 
the family factor, the factor of social 
experience, and the factor of self-in- 
sight. These are included to show the 
type of guide which was available to 
the rater. 


Rating on Hereditary Factor 


Consider the child’s strain of inheritance, 
as evidenced by parents, relatives, siblings; 
hereditary predisposition to disease; feeble- 
mindedness, epilepsy, or psychoses in the an- 
cestry; evidence of neuroses or physical or 
emotional instability in the ancestry; marked 
social inadequacy in the ancestry as shown by 
chronic alcoholism, repeated jail terms. On the 
constructive side consider freedom from dis- 
ease and taints and marked social adequacy. 
Rating on Physical Factors 


Consider the child’s inherited physical and 
neurological constitution; his physical develop- 
ment, size and weight in relation to norm; 
physical defects, inferiorities, or abnormal- 
ities; glandular dysfunction; physical insta- 
bility, nervousness, hyperactivity; disease his- 
tory, with special attention to long periods of 
illness, or diseases such as tuberculosis, epilep- 
sy, encephalitis, venereal disease, chorea; de- 
fects of the special senses. On the construc- 
tive side consider freedom from illness or de- 
fects, superior physique. 

Rating on Mentality Factor 


Consider the child’s mental capacities as 
shown by his development, intelligence test 
ratings, school achievement, vocational achieve- 
ment. Consider special abilities and disabil- 
ities which have a bearing on his mental func- 
tioning. Consider the quality of his intelli- 
gence, alertness, persistence, ability to con- 
centrate. 

Rating on Family Influences 


Consider the family circle within which the 
child has developed—the attitudes which have 
surrounded him. Consider the emotional at- 
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mosphere within the home—marital discord or 
harmony, sibling rivalries, attitudes of domi- 
nation, oversolicitude, rejection, or normal 
parental love. Frictions or conflicts in regard 
to illegitimacy or other family irregularity. 
The child’s reaction to the home is also to be 
considered—reactions toward parents and sib- 
lings, toward family standards and discipline. 
Degree of community of interests with other 
members of the family. 


Illustrative Ratings—Family 


--3 Mother quite openly immoral, father a 
weak individual who plays little part at 
home except when drunk when there are 
terrific quarrels. Mother controls chil- 
dren by beatings. They are at least par- 
tially aware of her immorality. 

—2 Parents not congenial; whole home domi- 
nated by father who is rigid, puritani- 
cal, and uses excessive discipline. He 
favors daughter and rejects this boy. 
Home atmosphere very tense. Mother 
furtively takes the boy’s side. 


—1 Father died when child in infancy. 
Mother centers all her attention and af- 
fection on this only child. Mother is ex- 
tremely oversolicitous and overindulgent, 
and has few outside interests. 

0 This boy is somewhat his father’s va- 
vorite, and being the oldest child, tends 
to dominate his younger sibs. Parents 
are both interested in the home, seem 
happy together, and have a great deal 
of affection for their children. 

+3 Parents are very congenial. Family at- 
mosphere harmonious and pleasant. 
Many special interests and activities 
fostered by parents. Children encour- 
aged to develop independence. This child 
feels very secure in the parental affec- 
tion. 


Rating on Economic and Cultural Influences 


Consider the family income, status of fath- 
er’s occupation, social standing in the commu- 
nity, degree of comfort and educative influ- 
ences within the home; consider the commu- 
nity type—whether delinquency area, residen- 
tial area, rural area; consider the community 
standards of behavior and culture; the school, 
libraries, and recreational resources available. 


Rating on the Social Factor 


Consider range and extent of child’s social 
experience; isolation or group contacts; the 
type of companions available, the social skills 


the child has achieved considered in relation 
to his age; experience in group membership 
and leadership; organizing ability and social 
initiative; status in the schoolroom group; 
friendships with own and opposite sex, consid- 
ered in relation to age; social relationships 
with adults; social adjustment to the neigh- 
borhood and community; general social matur- 
ity or lack of it. 


Illustrative Ratings—Social 


—3 This child is the sissy of the neighbor- 
hood—picked on by other boys, unhappy 
when with them. At school gets on sat- 
isfactorily, is well liked by the teacher, 
has trouble at recess. Has no real 
friends, but spends most of his free time 
with his sister three years younger. 

—2 Child has always been kept from much 
contact with other children; in a group 
is shy, backward, cannot play games; 
has two friends younger than self; gets 
on easily with adults. 

—1 This girl belongs to a YW club, attends 
irregularly, prefers to stay by herself 
and read; is a passively accepted indi- 
vidual in the schoolroom; has some com- 
panions in the neighborhood but no close 
friends. 


0 Boy 13, belongs to no organized club or 
gang. He has one chum with whom he 
goes to the movies, builds model planes, 
etc. Friendly with his school and neigh- 
borhood group. Plays on corner lot 
when urged by the group. 

+1 Boy 12, enthusiastic Scout, member of 
his grade team at school, lives in isolat- 
ed home, and has few neighborhood com- 
panions, goes to visit one of his Scout 
friends frequently. Is fair in baseball 
and swimming. 
+3 This girl is president of her high school 
class, popular at parties, interested in 
boys, has a girl chum who has been her 
companion for years; has taken an ac- 
tive part in school athletics. 
Rating on Education—Training—Supervision 
Consider the education, training, and super- 
vision the child has had outside the home. Or- 
dinarily this will mean primarily his school 
experience. Censider such things as the type 
of school which the child has attended; the 
changes of school; the continuity and consis- 
tency of school experience; consistency of dis- 
cipline, both in schoe]l and between home and 
schoel; the degree of healthy stimulation, the 
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extent to which tasks have been adapted to 
ability; the insight shown by teachers and 
school authorities; the behavior ideals actually 
inculeated; the cooperation and similarity of 
viewpoint between home and school. 


Rating on Self-Insight 

Consider in relation to the norm for his age, 
the degree to which the child has or lacks un- 
derstanding of his own situation and prob- 
lems; consider such things as defensiveness; 
inability to admit faults, or tendency to de- 
preciate self and exaggerate faults. Consider 
not only intellectual understanding of problem 
but emotional acceptance of the reality situa- 
tion. Consider child’s planfulness and willing- 
ness to take responsibility for self; ability to 
be objectively self-critical. Consider stability 
of attitudes—whether erratic and changeable 
or cautious and settled. 





Illustrative Ratings—Insight 

—3 This girl blames everyone else for her 
trouble and readily excuses herself. She 
will not face the fact that her situation 
is serious, and has a breezy optimism 
entirely unrelated to reality. 
(or—2) This boy’s sex behavior indi- 
cates real mental conflict. He can give 
a fair verbal account of the cause of his 
behavior, but his actions are little influ- 
enced. 

0 This boy has a rather inadequate knowl- 
edge of his own assets and liabilities; 
he has thought only a very little about 
his own future; he realizes to some ex- 
tent the fact that his parents tend to 
keep him childish. He shows no serious 
behavior problems. 

+2 (or +3) Living in a most unhappy home 
situation, this boy makes calm judg- 
ments as to the degree to which he and 
his stepfather are to blame, and helps 
make plans for his own future, away 
from home, on a carefully reasoned ba- 
sis. [5, pp. 378-383] 


In view of some of the findings to be 
presented later it should be pointed out 
that in the development of this instru- 
ment, the factor of self-insight was 
added rather apologetically at the end 
of the list. Says Rogers, in introduc- 
ing a discussion of this factor, “The 
seven factors which have been described 
would seem to be the basic elements 
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which, coming together in complex 
fashion, determine the behavior of the 
individual. For the young child an 
evaluation of these factors should be 
sufficient to gain an understanding of 
the child’s reactions. With the older 
child, however, the attitudes which he 
holds toward himself and his behavior 
are decidedly significant and worthy of 
evaluation. That these attitudes are 
formed by the interaction of the other 
factors in the child’s experience is un- 
doubtedly true, but they also operate as 
an important influence to shape his fu- 
ture behavior.” [5, pp. 48-49] 

Using this component factor instru- 
ment as described, Kell and McNeil 
rated each of the eight factors for each 
of the subjects in their groups. The 
material on which the ratings were 
based was the initial diagnostic study 
of the child made while he was at the 
Bureau of Juvenile Research. This ma- 
terial included written case histories, 
psychometric examinations, interviews 
with the child by a psychologist or psy- 
chiatrist, or both, report of physical ex- 
amination, and other similar informa- 
tion. The only materials which were 
not used in making the rating judg- 
ments were the overall diagnostic re- 
port compiled by the Bureau, and the 
follow-up information. The former was 
excluded because it was felt the ratings 
should be made on the basis of the ma- 
terial itself, rather than on someone’s 
interpretation of that material. The 
follow-up information was of course ex- 
cluded because it was to be rated inde- 
pendently. 

No measure of the reliability of the 
ratings in the present studies was made, 
but it has been shown by Rogers that 
the degree of reliability in the clinical 
use of these rating scales may be ex- 
pressed by the statement that in rating 
specific items, the standard deviation of 
clinician’s judgments ranges from .3 to 
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.6 of a scale step, with heredity and 
mentality showing the highest reliabil- 
ity, and family and self-insight factors 
the lowest. When six clinicians rated 
five cases (rather than specific items 
from cases) on every factor, the reli- 
ability was somewhat lower, 66 per 
cent of the judgments being in agree- 
ment within two scale steps on the sev- 
en point scale [5, ch. 3]. 


THE RATING OF LATER ADJUSTMENT 


In order to provide an objective meas- 
ure of the individual’s later adjustment, 
with which the initial ratings might be 
correlated, Kell devised a scale for ra- 
ting the behavior of the individual dur- 
ing the two or three year period follow- 
ing the diagnostic study. This too was 
a seven point scale ranging from ex- 
tremely poor adjustment to excellent 
adjustment. The typical characteristic 
which were set up for the different 
points on the scale are as follows. 


Rating Scale of Follow-up Adjustment 

—3 Extremely poor adjustment. Individual 
in difficulties constantly. A confirmed 
delinquent or criminal. If institutional- 
ized, makes an unsatisfactory adjustment 
there—fights continuously against regu- 
lations, disliked by other inmates, etc. 
If in own home, continually disrupts the 
family, a constant behavior problem at 
home and in school. Insane or extreme- 
ly neurotic. Finds few, if any, normal 
satisfactions. No satisfactory adjust- 
ment in any situation. 

—2 Poor adjustment. Continues in some de- 
linquent or criminal activities, but does 
not seem hopeless. In court a number 
of times. Gains most satisfactions in an 
anti-social manner. If institutionalized, 
makes a partial adjustment to the insti- 
tution’s routine and regulations. If in 
own home, continues as a behavior prob- 
lem most of the time, in conflict with 
school and may drop out. Cannot hold a 
job or function satisfactorily at one. 
May adjust satisfactorily in a few situa- 
tions. Seems quite neurotic. Cannot ad- 
just in foster home. 


—!1 


~ 


Near average adjustment. Continues in 
a few delinquent activities. May be in 
court once or twice. If institutionalized, 
makes a satisfactory adjustment and 
shows evidence of adjusting outside the 
institution. If in own home, continues 
as a problem, but not as a severe one. 
Continues as a school problem, but 
makes some progress. May be able to 
hold a job, but does not function too 
well at it. May exhibit some neurotic 
symptoms which have a slight effect on 
total adjustment. May have to be placed 
in several foster homes, but finally 
makes a fairly satisfactory adjustment. 
Adjusts in some situations and not in 
others. 

Average adjustment. In few, if any, 
delinquencies. May be in court once for 
minor delinquencies and then released. 
Neurotic tendencies mild and have little 
effect on total adjustment. Makes a 
satisfactory adjustment in the home— 
may have a few minor family difficul- 
ties. Makes average progress in school 
in relation to ability. Makes satisfac- 
tory adjustment in foster home. Is able 
to hold a job, but is not exceptional at 
it. Adjusts in most situations. 


Above average adjustment. Never in 
court again. Delinquent tendencies, if 
any, must be so mild that he is never in 
any serious difficulty. No evident neu- 
rotic symptoms. Very little aggressive, 
an*i-social behavior. Makes a good ad- 
justment to the family situation if re- 
turned home. Makes good progress in 
school. Does quite well on a job. Makes 
a good foster home adjustment. Ad- 
justs in nearly all situations. 

Very good adjustment. Seems to make 
the best of nearly every situation. No 
evidence of any delinquent tendencies. 
No anti-social behavior. Makes a good 
school adjustment. Does very well on a 
job. Never any evident conflict with 
family if returned home. Makes a very 
satisfactory foster home adjustment. 
Excellent adjustment. Makes the best 
of every situation. Never any question 
of stability or anti-social trends. Seems 
to make best possible adjustment to 
family. Excellent adjustment in school, 
college indicated, etc. Makes excellent 
progress on a job. Foster home adjust- 
ment the best possible. [3, pp. 26-27] 
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Using this rating scale Kell and Mc- 
Neil turned to the follow-up reports of 
the cases in their respective groups, 
and, without reference to the diagnos- 
tic study, evaluated the two to three 
years of behavior which was described 
in the follow-up material. This materi- 
al was made up of reports from proba- 
tion officers, social workers and institu- 
tion officials. 


To illustrate the range of later ad- 
justments which were found in the 
group, and the use of the rating scale 
on adjustment, Kell’s notes abstracting 
the follow-up reports on three cases, 
and the ratings assigned to these cases, 
are given below: 


—3 Ran away from foster home. Committed 
to Boys’ Industrial School for stealing. 
Later released. Practiced sex perver- 
sion. Committed to Massillon State 
Hospital—ran away from there. Very 
poor present adjustment. Continuing 
sex perversion. 

0 Girl made a fair adjustment in first 
foster home. Did not get along well in 
second and third foster homes. Later 
made a good adjustment in a fourth fos- 
ter home. Now married. Apparently is 
doing well. 

+2 Boy has graduated from high school 
with good marks. Now employed as a 
blueprint reader at $40.00 per week. 
Adjustment very good. Says, “BJR is 
the best thing that ever happened to 
me.” [3, pp. 28-29]. 


A word is in order in regard to the 
experiences of these children during the 
follow-up period. It is fortunate for the 
purposes of this study (though not for 
the children) that very little in the way 
of intensive casework or psychotherapy 
was utilized in the treatment of these 
delinquents. We say that this is for- 
tunate for the study, because obviously 
the aim of all treatment is to defeat the 
statistical probabilities involved in pre- 
diction. That is, the caseworker or ther- 
apist in working with a person, is en- 
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deavoring to alter the behavior which 
would objectively be predicted for this 
individual, and thus is hoping to make 
the prediction an erroneous one. The 
only type of treatment recommenda- 
tions which were apt to be carried out 
in the group under study were the rec- 
ommendations that the child be placed 
on probation, or placed in a foster home 
or institution. There is no way of meas- 
uring or indicating the amount of treat- 
ment effort invested in these children. 
It may be said, however, that the 
amount was relatively small, and that 
if one grants any efficacy to treatment 
effort then in so far as this study is 
concerned, it would only act to reduce 
tie accuracy of behavioral prediction. 
In other words, whatever predictive ac- 
curacy is achieved by the method used, 
it is safe to say that it would have been 
greater had no treatment of any kind 
been attempted. 


FINDINGS 


We are now ready to consider the 
analysis of the data collected. It should 
be clear that for each child in the two 
groups we have a rating on each of 
eight factors as to the extent to which 
those factors are likely to produce nor- 
mal or well adjusted behavior. These 
ratings were made on the basis of in- 
formation available at the time the 
child came to the BJR. We have also 
independent ratings of the child’s ad- 
justment during the two year period 
following the initial study. The major 
aspect of the analysis consists in the 
correlation of these predictive judg- 
ments with the evaluations of actual be- 
havior. 

The first finding of significance is 
that all the predictive factors which 
were rated showed a positive correla- 
tion with later adjustment. That is the 
child with good heredity, or good health, 
or favorable family environment, etc. is 
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more likely to display normal and well 
adjusted behavior during the two year 
period following study than is the child 
who is less favored in any of these re- 
spects. This would tend to support the 
general hypothesis that behavior is the 
result of multiple causation, and that 
the factors which were selected for 
study are at least some of the effective 
elements which seem to determine ad- 
justment or maladjustment. 

But the unexpected finding which 
gives quite a different meaning to this 
material is the predictive importance of 
the individual’s understanding of him- 


self. As will be seen from Table II, the 


TABLE II 
CORRELATION OF RATINGS ON COMPONENT FAC- 
TORS WITH RATINGS OF LATER ADJUSTMENT 











Correlations with 








Adjustment 
Factor Kell Study McNeil Study 
(N75) (N76) 

Self-insight ......... .84** Ai 
Social experience.. .55** .36** 
Mentality -............. 39** 15 
Hereditary ............ 37** .23* 
Family 

Environment .... .36** 14 
Economic and 

Cultural ............ .28* 07 
a .25* 13 
Education and 

training ............ 11 .20 
Total averaged 

I siccititecciae .66** 27° 











**These correlations are significant at the 1% level of 
confidence. 


*These correlations are significant at the 5% level. 


correlation between self-insight and 
later adjustment was .84, an unusually 
high relationship for material of this 
sort. It was this surprising finding 
which lead the investigators first to 
check the data for possible errors and 
finally to lay it aside until it could be 
thoroughly rechecked on a new group. 
In the McNeil study, all the correlations 
are consistently lower, a puzzling fact 


which we have been unable to explain, 
but self-insight again comes out as the 
best predictor of behavior, correlating 
41 with outcome. 

In both studies the factor which was 
second in predictive significance was 
the social experience and social ade- 
quacy of the child. The respective cor- 
relations were .55 and .36, both statis- 
tically significant. The relationship be- 
tween the other factors and adjustment 
was positive, but lower than these two, 
with the McNeil study finding lower 
significance for the factors of mentality 
and economic-cultural influence, and 
somewhat higher weight for education 
and training, when her results are com- 
pared with those of Kell. 

As would be expected, when the vari- 
ous ratings on the separate factors 
were averaged, they correlated positive- 
ly with outcome, r’s of .66 and .27 re- 
spectively being obtained in the two 
studies. This represents a questionable 
method of prediction, where the factors 
obviously have different weightings. 

The material from Table II may be 
summarized by stating that in predict- 
ing the behavior of a problem adoles- 
cent, the extent to which he faces and 
accepts himself, and has a realistic 
view of himself and reality, provides, 
of the factors studied, the best estimate 
of his future adjustment. The second 
best predictor would be the satisfactori- 
ness of his social contacts, the adequacy 
of his social relationships. These two 
are outstandingly better bases of pre- 
diction than any of the other factors 
studied, but positive correlation with 
later adjustment is found in ratings of 
the hereditary stock from which the in- 
dividual has sprung; his mentality and 
mental functioning; the emotional cli- 
mate of his family environment; his 
physical condition and health; and fi- 
nally the economic, cultural, and educa- 
tional influences to which he has been 
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exposed. These factors would be of pre- 
dictive significance roughly in the order 
named. 


Further Analysis Related to Self- 
Insight 


Since the factor which had most 
doubtfully been included in the Compo- 
nent Factor method proved to correlate 
most highly with outcome, special at- 
tention will be given to its analysis. 

In the first place, the reader may 
wish to know the type of material upon 
which the ratings were based. Here are 
some of the summarized notes from the 
two investigator’s records, indicating 
the material relating to  self-insight 
which was found in the cases, and the 
rating based upon it. 


—3 Refuses to disci®ss his delinquencies; 
will not or cannot discuss problems aris- 
ing out of family conflicts; denies his 
share of responsibility even when con- 
fronted with the facts. [4, p. 34]. 
Quite frank and open in discussing her 
misbehavior, but stories are unreliable. 
Is proud of her misbehavior—does not 
feel responsible. Does not recognize 
that family situation is the cause of 
much of her trouble. [3, p. 20]. 


bo 


—1 Cautious, fairly truthful, correcting 
statements on own initiative. Feels some 
responsibility, realizing he is too easily 
influenced. Makes no complaints about 
the family but appears to understand 
somewhat its poor influence. [4, p. 35]. 


_ 


Understands his home situation fairly 
well, not clear about his relationship to 
it. Recognizes source of difficulties, but 
needs help in managing them. Admits 
his delinquencies truthfully with some- 
thing similar to “They were not to 
blame. I was on the wrong track.” [4, 
p. 35]. 

+2 Freely admits her delinquencies, recog- 
nizing and accepting the basis of paren- 
tal antagonism and rejection. Planful 
and cooperative. Responsible when 
placed on her own. Tells facts frankly, 
recognizes and understands mother’s in- 
stability and her own need for personal 
responsibility. Responsive and coopera- 


tive in behavior and in making future 
plans. [4, p. 35). 


These examples may be sufficient to 
indicate the rather crude character of 
the material available for making this 
as well as the other ratings. If such 
significant correlations are achieved on 
the basis of general case material, the 
possibility is at least suggested that 
more refined ways of investigating the 
degree of self-understanding might give 
even more significant results. 

Since both self-insight and the social 
factor gave high correlations with out- 
come, it was thought wise to investigate 
the degree of relationship between these 
two factors. In the Kell group the cor- 
relation between the ratings on self-in- 
sight and the ratings on the social fac- 
tor was .66, in the McNeil group .63. 
This is a high degree of interrelation- 
ship which does not seem to be explain- 
able on the basis of similarity of defini- 
tions of the two factors, or similarity 
of the material being rated. For exam- 
ple, the notes from three cases as to the 
social factor, with their respective ra- 
tings, are as follows. 

Does not get along well with sibs or 
school companions. Quarrelsome. Mis- 
treats other children, and cruel to small 
children and animals. Not successful in 
trial social adjustment opportunities. 

Somewhat of a leader among the older 
delinquent boys. Has a passable man- 
ner, likes sports, likes to impress the 


girls. 


— 


2 Plays on a team. Friends are not delin- 
quents. Good mixer, liked by others in 
the neighborhood and school. Has a good 
stamp collection. Has three very close 
friends. [4, pp. 35-36]. 

There would seem to be no obvious 
reason why ratings based on this type 
of data should correlate closely with 
ratings made on self-insight. It would 
seem that the relationship may be of a 
more underlying nature. 

In another attempt to analyze the 
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meaning of the high correlation of the 
self-insight factor with later adjust- 
ment, this correlation was separately 
computed for boys and girls, and for 
negroes and whites. The differences 
were not striking, and some of the 
groups were small, but in both studies 
the correlation was higher for the girls 
than for the boys, and for the negroes 
than for the whites. 


Another line of investigation gave 
special consideration to those children 
who remained in their own homes dur- 
ing the follow-up period. It had been 
a surprise to the investigators that 
family environment had not correlated 
highly with outcome, and that self-un- 
derstanding had correlated so highly. 
As the material was examined, it ap- 
peared possible that the fact that a siz- 
able number of children from the poor- 
est homes had been removed from their 
own families as a result of the diagnos- 
tic study, might have influenced these 
results. Consequently both Kell and Mc- 
Neil selected from their groups those 
children who had been returned to their 
own homes during the follow-up period. 
They also endeavored to determine 
whether the factor of self-insight was 
less operative when the home conditions 
were very unfavorable, by selecting out 
those with family factors rated —2 or 
—8, who had been returned to these 


TABLE Ill 


THE CORRELATION OF SELF INSIGHT WITH AD- 
JUSTMENT AMONG CHILDREN RETURNED 
To THEIR OWN HOMES 





Kell’s stu McNeil’s study 








Group N ; r N r. 





Children whose family 
environment was 
rated -2 or -3.................... 28 -76** 28 31 

Children whose family 
environment was 


rated -1 or 0................... 15 .78** 12 49 
All children returned to 
their own homes.............. 43 -79** 47 -43** 





**Significant at the 1% level of confidence. 


very unfavorable homes. The results 
are shown in Table III. It will be seen 
that the correlation between insight 
and later adjustment is relatively un- 
changed, even when the child comes 
from and returns to, a very unfavorable 
home situation. It is still true that a 
much better prediction of adjustment 
can be based upon a consideration of 
the degree of self-understanding, than 
upon any analysis of the home environ- 
ment. McNeil further checked this by 
correlating the family environment fac- 
tor with later adjustment in the group 
of 47 children returned to their own 
homes. This r was .20. It is higher 
than the similar correlation for the 
group as a whole, (.14 in her study) but 
much lower than the correlation of .43 
between self-insight and later adjust- 
ment. 

When the child is removed from his 
own home and placed in a foster home, 
the operation of self-insight as a pre- 
dictor is enhanced. There were 10 chil- 
dren in Kell’s group thus placed and 15 
in McNeil’s. The correlations between 
self-insight and later adjustment for 
these two small groups were .98(!) and 
.54 respectively. Both of these correla- 
tions are significant, the first at the 1% 
level and the second at the 59% level, in 
spite of the small numbers involved. 


Limitations of the Findings 


Since some of the findings of these 
studies appear to have considerable sig- 
nificance if they are confirmed by other 
research, it should be mentioned that 
they were uncovered in investigations 
which have certain flaws and limita- 
tions. Those limitations which are evi- 
dent to the investigators will be briefly 
stated. 

It is unfortunate that there is no 
study of the reliability of the compo- 
nent-factor ratings in these two studies. 
Knowledge of the degree of reliability 
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present in a previous study does not en- 
tirely compensate for this. There is no 
study of the reliability of the ratings on 
final adjustment. 

A more serious flaw is the fact that 
the same judge rated both the initial 
factors and the final adjustment, even 
though these ratings were made inde- 
pendently and some time apart. The in- 
vestigator made some 600 ratings of in- 
dividual factors in the 75 cases, then 
without reference to these or to the ma- 
terial upon which they were based, 
made the ratings on the follow-up ma- 
terial. It would certainly be preferable 
to have another judge make these judg- 
ments. It may be said, however, that 
if there was any unconscious bias oper- 
ating in this situation, it could not ac- 
count for the surprising showing of the 
self-insight factor, since whatever bias 
existed was in the direction of suppos- 
ing that the emotional climate of the 
family was probably the most influen- 
tial factor in the determination of be- 
havior. 

Another limitation of the studies as 
a whole is the fact that the rating scales 
for the eight factors and also for the 
later adjustment are crude instruments 
lacking in the degree of refinement 
which would be desirable in objective 
research. The information in the case 
folders was also often lacking in the 
specificity which would be desirable. 

These limitations are real, vet their 
operation would for the most part tend 
to reduce correlations. There would 
seem to be nothing in the design or con- 
duct of the study which would explain 
the degree of relationship which was 
found between self-insight and adjust- 
ment. 

There is one other element in the 
studies which deserves critical consid- 
eration, and that is the sharp difference 
in the correlations found by the two in- 
vestigators. It appears from an exami- 
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nation of the data that it is not due to 
any difference in the range of the ra- 
tings, or to any statistical artifact 
which can be discovered. Whether it is 
due to a difference in clinical discrimi- 
nation in making the ratings, or to 
some other cause, is unknown. As long 
as it is unexplained, it would appear 
that it might cover some unrecognized 
source of error. 


Summary of the Findings 


To recapitulate the findings of the two in- 
vestigations: 

1. The ratings of the eight factors specified 
in the component-factor method all 
showed a positive correlation with ratings 
of the individual’s later adjustment, in 
the group of 151 cases studied. 

The size of these correlations as found in 

the two studies differed sharply in 

amount, but there was a high degree of 
correspondence in the relative significance 
of the factors. 

3. The rating of the individual’s understand- 
ing and acceptance of himself and the 
reality situation was, in both studies, the 
best predictor of what his future adjust- 
ment would be. 

4. In both studies the factor which was sec- 
ond in predictive capacity was the social 
experience and social adequacy of the in- 
dividual. 

5. In decreasing order, these factors were 
also found to have some capacity for pre- 
diction of future behavior; the heredity 
of the individual; his intellectual func- 
tioning; the emotional atmosphere which 
the child has experienced in the family; 
the economic and cultural conditions 
which have surrounded him; the quality 
and consistency of his educational envi- 
ronment. 

6. A high degree of relationship was found 
between the rating on self-insight and the 
rating on social experience. This corre- 
lation does not appear to be explained on 
the basis of simple overlapping of ma- 
terials rated, but may involve some deeper 
relationship between the two factors. 

. In the group of children who came from, 
and remained in, highly undesirable at- 
mospheres, it was still true that the de- 
gree of self-understanding was the best 
predictor of adjustment, much better than 
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an evaluation of the home influence itself. 
8. In children who are removed from highly 
undesirable home atmosphere and placed 
in foster homes, the degree of self under- 
standing is a decidedly accurate predictor 
of future adjustment or maladjustment. 


IMPLICATIONS OF THE FINDINGS 


Only gradually, as the clinical experi- 
ence of the authors has pointed in the 
same direction as the results of this re- 
search, has the full significance of the 
foregoing findings been recognized and 
appreciated. Only as work in psycho- 
therapy has driven home the impor- 
tance of the individual's concept of him- 
self and his relation to reality, and the 
close relationship between these per- 
ceptions and his behavior, have the 
findings of this research been under- 
stood. [See reference 6 for an expres- 
sion of this line of thought.] It is an- 
other experience to illustrate that ob- 
jective facts have little meaning until 
they fit, in some recognizable way, into 
our frame of reference. 

If the present studies are confirmed 
in their central findings by further re- 
search, then there are three broad im- 
plications which deserve consideration. 
The first is the socially hopeful charac- 
ter of the findings. Studies in predic- 
tion based upon correlating isolated 
background facts with later adjustment 
seem uniformly depressing because 
they add up to the total conclusion that 
the more adverse the factors operating 
in the individual’s life, the more hope- 
less he becomes, from any social point 
of view. The present studies do not 
flatly contradict this conclusion. It is 
true that a poor heredity and the pres- 
ence of destructive organic factors, and 
a culturally deprived background, all 
predispose, to some degree, toward a 
less adequate adjustment. But the sig- 
nificant fact is that the element which 
above all others should be the most sub- 
ject to natural change or planned alter- 


ation, the individual’s acceptance of 
himself and of reality, is also the most 
important determiner of his future be- 
havior. Rather than feeling that a per- 
son is inevitably doomed by unalterable 
forces’ which have shaped him, this 
study suggests that the most potent in- 
fluence in his future behavior is one 
which is certainly alterable to some de- 
gree without any change in his physical 
or social heredity or in his present en- 
vironment. The most powerful determi- 
nant would appear to lie in the attitudes 
of the person himself. 


A second implication which should be 
mentioned is that the results of these 
studies would point toward a drastic 
revision of the methods of dealing with 
or treating individuals who exhibit de- 
linguent or problem behavior. In the 
groups which were studied, and in oth- 
er similar groups, practically all of the 
investment of money and effort is di- 
rected toward altering factors which 
appear to be only to a small degree de- 
terminative of behavior. Vast amounts 
are expended on foster homes and chil- 
dren’s institutions in order to alter the 
child’s whole environment, considerable 
amounts on probationary supervision 
which is little more than a checking-up 
on the youngster, considerable sums on 
the alleviation of physical deficiencies, 
but practically nothing on any direct 
approach to the problem of revising the 
child’s attitudes toward himself. Like- 
wise only a small fraction of the total 
treatment effort goes to changing the 
child’s social adjustment, which appears 
to be second only to self-insight in its 
significance. 


If treatment effort was to be expend- 
ed in most efficient form, in the light 
of the results of this study, then effec- 
tive psychotherapy, either individual or 
group, aimed at helping the child 
achieve a more realistic acceptance of 
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his impulses and abilities, and a rea- 
listic appraisal of his situation, would 
be the major investment. Social experi- 
ences might need to be provided con- 
currently, or the psychotherapy might 
assist him in developing more construc- 
tively the social relationships which he 
has. In any event, it would not be the 
quantity of social contact, but the de- 
gree to which the individual built ma- 
ture give-and-take relationships with 
others, which would be regarded as im- 
portant. A distinctly lesser amount of 
effort might be expended in endeavor- 
ing to improve the family relationships, 
and the economic status. Some effort 
to enrich the cultural stimulation of the 
child might also be justified. The pri- 
mary aim throughout, would be to pro- 
vide the opportunities for emotional re- 
lease, insightful acceptance of self, and 
positive reorientation of self, which 
every successful. psychotherapy entails. 
Such opportunities might be offered 
through the clinic, through the class- 
room with a specially trained teacher, 
through special school counseling serv- 
ices, or through group therapy carried 
on in conjunction with a recreational 
group. The whole focus of effort would 
be almost the reverse of the accepted 
procedures at the present time. 

The final implication carried by the 
results of this study is that if the indi- 
vidual’s view of himself and reality is 
so important—the degree of his defen- 
siveness, the degree of acceptance of 
himself, his realistic appraisal of real- 
ity, his degree of independence and 
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planfulness, his ability to be objectively 
self-critical—then a great deal of re- 
search is needed in this area. Studies 
are needed to discover how healthy per- 
ceptions of this sort occur, and the cir- 
cumstances which cause the individual 
to become defensive and lacking in in- 
sight. We need much deeper research 
into the way in which the individual 
views himself, and the fashion in which 
his internal view of experience influ- 
ences his behavior. Finally we need 
penetrating investigation of the ways 
in which such views of experience may 
be altered in the direction of realism 
and self-acceptance. Such research 
would move us forward a great distance 
in our knowledge of how to deal with 
those with behavior disorders. 
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A STUDY OF THE KENT AND BUCK SCREEN TESTS OF 
MENTAL ABILITY IN RELATION TO OTIS 
AND STANFORD ACHIEVEMENT 
TEST SCORES’ 


By CHARLES N. COFER 
UNIVERSITY OF MARYLAND 
AND 

MARK M. BIEGEL 


THE GEORGE WASHINGTON UNIVERSITY 


CREEN TESTS of intelligence were 
widely used by military psycholo- 
gists during the war [6], the most wide- 
ly used tests of this type being those de- 
vised by Kent [7, 8, 9,]. Recently, an- 
other test of this kind has been devel- 
oped by Buck [2]. Because it would be 
advantageous to have alternate tests of 
this type, one purpose of the present 
study was to determine the degree to 
which the Kent and Buck tests are re- 
lated. 


Several studies have reported rather 
high correlations between the Kent tests 
and other measures of mental ability 
[1, 3, 4, 5, 11, 12, 13, 14, 15; see also 
Buck, 2]. In these studies, the tests with 
which the Kent has been compared have 
usually been individual measures of in- 
telligence. Little attention has been paid 
to the relationship of the screen tests 
to educational achievment. As a second 
aspect of this study, the Kent and Buck 
test scores were compared with scores 
made on a group test of mental ability 
and on a standarized educational achiev- 
ment test. 


1The S’s used in this study were obtained 
from the National Training School for Boys 
and were tested there. We wish to express ap- 
preciation to the officials of this institution for 
the cooperation which made this study possible. 
Mean test results reported here apply, of 
course, only to our particular sample and are 
not to be considered as representative of the 
institution population. 


METHOD 

One hundred first offenders, recent- 
ly admitted to a federal correctional in- 
stitution for boys, served as S’s. The 
testing was done while each S was in 
the receiving Unit of the institution. 
The Otis Group Intelligence Scale, Ad- 
vanced Examination, and the Stanford 
Achievement Test, 1940 revised edition 
(Intermediate and Advanced) are ad- 
ministered routinely to the new admis- 
sions to the institution. The Buck Time 
Appreciation Test [2] and Scale D of 
the 1946 edition of the Kent Scales[10] 
were administered to each S just before 
he left the Receiving Unit. Both screen 
tests were given during the same ses- 
sion, and one examiner administered 
both of them. 

The group studied had a mean chrono- 
logical age of 16 years, 4 months (med- 
ian of 16-5), with a range from 15 
years, 3 months, to 17 years, 10 months. 
Educational level, as reported by the 
S’s, ranged from fifth grade to eleventh 
grade with a mean grade completed of 
8.22 (median of 8.48)*. The S’s came 
from a wide geographical area. The 
Southern states (as far west as Texas) 
contributed 43 percent of the sample; 
the North Atlantic states contributed 

?No check is made by the institution on the 
accuracy of the reports of educational level. 


Since these data may therefore be unreliable, 
no further consideration is given them here. 
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31 percent, the Midwestern states (Ohio 
to the Dakotas) 21 percent, and the far 
Western states 5 percent. 


RESULTS 


1. Kent and Buck tests. The mean 
Mental Age obtained for the Kent, Scale 
D, was 12 years, 7 months (S. D. of 
3.65), and for the Buck was 12 years, 
5 months (S. D. of 3.62). The correla- 
tion coefficient between the scores on 
these tests was 0.88 (+ .0167)* Thus, it 
can be seen that very similar results are 
given by the two tests. In 72 percent of 
the cases the difference in obtained MA 
on these two tests was six months or 
less; it was a year or less in 97 percent 
of the cases. 

2. Kent, Buck and Otis tests. The 
mean MA obtained for the Otis test was 
12 years, 6 months (S. D. of 3.68). This 
mean falls between the means for the 
Kent and the Buck. The r between the 
Kent and the Otis scores was 0.86 
(+.0176) and between the Buck and 
Otis scores was 0.84 (+.0196). The 
screen tests are thus seen to yield re- 
sults very similar to those obtained 
from the Otis. This would, of course, 
not be the case with illiterate S’s. 

3. Kent, Buck and Stanford Achiev- 
ment tests. The mean educational age 
obtained for the Stanford Achievment 
test was 11 years, 7 months (S. D. of 
3.64). This corresponds to a mean grade 
placement of 6.5 The mean educational 
age falls 12 months below the mean MA 
obtained for the Kent and 10 months be- 
low the mean MA obtained for the Buck. 
The r between the Kent and the Stan- 
ford Achievement test scores was 0.79 
(+.0253) and between the Buck and the 
Stanford Achievement test scores was 
0.89 (+.0140). The difference in size of 


8As might be expected from the restricted 
range of CAs, ali r’s reported here remained 
unchanged when partial r’s were computed 
with CA held constant. 


these correlation coefficients is signifi- 
cant, yielding a critical ratio (Diff./sig- 
ma Diff.) of 3.57. 

Both screen tests, then, yielded men- 
tal ages which are higher than the edu- 
cational ages of these S’s, but the Kent 
scores do not seem to be quite so highly 
associated with educational achieve- 
ment as are scores on Buck’s Time Ap- 
preciation Test. 


SUMMARY 


One hundred juvenile delinquents 
were examined by means of two screen 
tests of mental ability, a group intelli- 
gence test, and an educational achieve- 
ment test. The screen tests were shown 
to be highly related to each other and to 
the Otis Group Intelligence Scale for 
these S’s. The educational ages of the 
S’s were shown to be inferior to their 
MA’s as obtained on the screen tests 
(and also on the Otis), but scores on the 
two screen tests were shown to be high- 
ly associated with educational achieve- 
ment, as measured by the Stanford 
Achievement Test. Of the two screen 
tests, the Kent test (Scale D) seemed 
less related to educational achievement 
than the Buck Time Appreciation Test. 
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A NOTE REGARDING THE USE OF THE SENTENCE 
COMPLETIONS TEST IN MILITARY INSTALLA- 
TIONS SINCE THE BEGINNING OF 
WORLD WAR II 


By AMANDA R. ROHDE 


NATIONAL HOSPITAL FOR SPEECH DISORDERS, NEW YORK, N. Y. 


N RECENT years a number of arti- 
I cles have been published in psycho- 
logical journals reporting the utiliza- 
tion of the sentence completions method 
in the diagnosis of mental patients in 
military hospitals, as a screening de- 
vice in the selection of personnel, and 
in other military programs. The writer 
[7] previously briefly reviewed experi- 
ments involving the use of this method 
in the study of personality made before 
the opening of World War II, and at 
that time described the derivation and 
development of Sentence Completions’ 
a test prepared by Rohde and Hildreth 
to be used as a projective technique in 
the investigation of personality, especi- 
ally adapted for group administration. 

Considerable confusion appears to ex- 
ist, however, as to the origin of a num- 
ber of adaptations which have been 
made of the above mentioned test since 
its publication in 1940. A brief review 
of the adaptations which have appeared 
under various captions may be of in- 
terest. 

The first of the articles describing 
the use of the sentence completions 
method as one of several projective tests 
used in diagnosing mental patients was 
published by Holzberg [3]. This was a 
discussion of Shor’s unpublished “Notes 
on the Use of the Self-Idea Completions 
Blank”. Its use in Mason General Hos- 


1Sentence Completions by Amanda R. Rohde 
and Gertrude Hildreth, copyright, March, 1940. 


pital, Brentwood, N. Y. was described. 

In this article the sentence complet- 
ions test items were given as they were 
used at that time. This apparently was 
the first form of Shor’s adaptation. In 
a later publication Holzberg and others 
[4] described the use of this test among 
other projective techniques used as an 
aid to neuropsychiatry, listing the Ror- 
schach, Thematic Apperception, Person- 
ality Projection Sheet, Bender-Gestalt 
Design, and Drawing a Man anda Wom- 
an. The “Personality Projection Sheet” 
referred to in this article is the previous- 
ly termed “Self-Idea Completions 
Blank,” containing the same sentence 
beginnings with a few minor changes. 

Shor [9] described this later form of 
the sentence completions test as “A 
Verbal Projective Technique”. Since his 
article predates that of Holzberg’s re- 
cent paper, the test was still called the 
“Self-Idea Completions Test (SIC)”. 

The fifty sentence beginnings com- 
prising Shor’s SIC, given in Holzberg’s 
[3] earlier article, and later with some 
changes by Shor [9], were reduced to 
forty items to constitute the form known 
in the Air Forces Aviation Psychology 
Program as “DE303A” [1, pp. 150-157]. 
This version of the test was reproduced 
by Rotter and Willerman [8] who sta- 
ted, “The original forms worked with 
in this study were used in the armed 
forces by Max L. Hutt, Joel Shor, Jules 
Holzberg, and others.” 
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Referring to the writer’s work with 
the sentence completions method they 
wrote, “Rohde recently published a 
study involving the use of the incom- 
plete sentences method with school chil- 
dren. Since most previous scoring has 
been subjective and dependent upon un- 
usual clinical skill, one of the purposes 
of the study was to devise a method of 
scoring which would provide consistent 
results with relatively untrained scor- 
ers. This report describes the develop- 
ment and derivation of this method.” 
[8, p. 43.] 

The above comments regarding the 
writer’s work with the sentence com- 
pletions method are in general mislead- 
ing. To begin with, in stating that “most 
previous scoring has been subjective,” 
they seem to have overlooked the fact 
that the writer’s paper was received in 
the publisher’s office, March, 1945, and 
that at the time no reports involving 
studies of the use of sentence comple- 
tion tests, per se, had been published 
except those briefly reviewed by the 
writer at that time. In those studies the 
scoring had been done objectively or 
semiobjectively rather than subjective- 
ly. It should be mentioned in this con- 
nection that the major part of the writ- 
er’s experiment referred to above was 
completed before 1941. At this time 
very few people had utilized the sen- 
tence completions method in investi- 
gating personality, thus the first pur- 
pose in the report was to describe the 
development and derivation of this 
method, and of Sentence Completions, 
the test used in the experiment.? The 
chief purpose was to validate the sen- 
tence completions method and the test 
as a projective technique for appraising 
personality. 

2Norman Cameron (2) employed 15 uncom- 
pleted sentences ending in because as a logical 
problems test. A footnote in the AAF report 


(1) states that the sentence completions test 
used was.based on Cameron’s study. 


As for devising the scoring scheme 
for “relatively unskilled scorers,” the 
writer did not presume to have devised 
the system, since this was done by Mur- 
ray et al. [6]. The writer merely uti- 
lized it,* not with the specific intention 
of “providing a scoring scheme for rela- 
tive-unskilled scorers,” but rather be- 
cause the system provides sufficient 
scope and complexity to permit adequate 
analysis and description of personality 
in well-defined terms. This is generally 
agreed to be highly important to the un- 
derstanding of the individual. Anyone 
thoroughly familiar with the Murray 
system will hardly consider it to have 
been designed especially for the use of 
untrained interpreters of psychological 
tests. 

During the exigencies of war-time 
conditions when all available means and 
techniques were used to the best advan- 
tage, a sentence completions test, adap- 
ted for the particular needs of the Of- 
fice of Strategic Services Program, was 
prepared. It contained one hundred 
items and was considerably more struc- 
tured than the Rohde-Hildreth test. In 
an article describing the tests used in 
this program Murray and MacKinnon 
[5] list the sentence completions test as 
part of a battery of projective techniques 
used in selecting personnel for their mil- 
itary unit. They stated, “Projective 
tests, such as Sentence Completions, 
Thematic Apperception, Rapid Projec- 
tion Test, the Rorschach, and so forth, 
were used primarily to uncover re- 
pressed tendencies which might affect a 
candidates motivation or emotional sta- 
bility.” 

Morris I. Stein [9] recently published 
a report of a study utilizing a sentence 
completions test which he claimed to be 
an adaptation of the version prepared 

’The writer is indebted to Professor H. A. 


Murray for permission to quote and borrow 
from his works. 
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for the Office of Strategic Services As- 
sessment Program mentioned above 
(OSS).* 

A study of Stein’s adaptation reveals 
that the test consists of quotations from 
the source he gave, filled in with numer- 
ous items from the Rohde-Hildreth test 
substituted for the sentence beginnings 
which had been used during the war, 
but now are no longer suitable. Since 
the OSS version of Sentence Comple- 
tions contains fifteen items quoted ver- 
batim, or in slightly modified form, 
from the Rohde-Hildreth test, and over 
fifty items in which the significant ideas 
were used in a more structured form, 
the Stein adaptation is heavily loaded 
with material from the same source. 


In Shor’s adaptations of the Rohde- 
Hildreth Sentence Completions test 
many of the sentence beginnings may be 
traced through the various versions in 
“Form I” published by Holzberg [3] to 
the final “Form V” which was used in 
the AAF [1]. Thus “If I” in the original 
became “If only .. .” in his Form I. and 
was contracted to the “extremely am- 
biguous ‘I... .’” in form V. while the 
original “There are times...” became 
“Sometimes...” “My worst...” quoted 
in Form I. emerged as “I can’t...” in 
the AAF form, and “My father...” was 
variously used as “My father usual- 
ly...,” “My father used to...,” and 
finally as the original “My father....” 
“IT envy...” was quoted in Form I, but 
metamorphosed to “I hate...” in the 
final form. One of the most interesting 
developments was the change of our “At 
home...” to their “Back home...” 
shrinking to “Back...” in Form V. 


The final form of Shor’s and his co- 
workers’ adaptation of the Rohde-Hil- 
dreth test, DE303A, reproduced by Rot- 
ter and Willerman [8], contains ten sen- 


*A more extensive report is given by the 
OSS Assessment Staff (11). 





tence beginnings quoted directly and six- 
teen quoted in slightly modified form. 
The remaining items are paraphrased 
versions of the source items. 


It was found that all except seven of 
the items in the Rohde-Hildreth test 
were used in some form in one or more 
of the adaptations made of this test. 
Twenty-one items were quoted verbatim, 
sixteen were used in slightly modified 
form and twenty were adapted by para- 
phrasing the central idea. One basic 
thought frequently was expanded in a 
number of sentence beginnings in the 
OSS and Stein versions. 


In view of the amount of work which 
had been done by the writer in selecting 
the test items,’ it was heartening to dis- 
cover that so many of the sentence be- 
ginnings had survived the rigorous 
elimination processes to which they 
were subjected by the persons who found 
them useful for the purposes of their 
tests. The lack of recognition of the 
source from which they had drawn those 
items was not so heartening. 


The origin of the test under discus- 
sion was explained in a previous article 
[7], but it might be well to mention 
again that the credit for first using the 
sentence completions method as a pro- 
jective technique in the study of person- 
ality, undoubtedly, belongs to Dr. A. F. 
Payne. In 1928 he devised the test re- 
vised by Rohde and Hildreth in 1939, 
the form from which the above men- 
tioned adaptations were made. The his- 
tory of the previous use of this method 
for mental testing and research in edu- 
cational psychology ever since Ebbing- 


5The responses to two sets of experimental 
test stimuli were tabulated. Selection of the 
sentence beginnings retained were made on the 
basis of criteria defined in a previous article 
[6], and subsequently further delineated in the 
manual for Sentence Completions published by 
the writer. The manual is available from the 
Psychological corporation, 522 Fifth Ave., New 
York 18, N. Y. 
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haus invented the technique for testing 
the mental capacity of children in Bres- 
lau in 1897, is too well known to require 
reiteration. 


to 
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HE FOUR groups in this study, 
the White, the Colored, the Mexi- 
can and the Indian, all were classified as 
illiterate on the basis of objective tests 
upon induction into the Army; all met 
the common criterion of graduation 
from the Ninth Service Command Spe- 
cial Training Center, located for nearly 
two years at Camp McQuaide, Califor- 
nia, the basis for graduation consisting 
of attaining certain predetermined mini- 
mum scores on two objective tests, one 
of reading, one of arithmetic. In terms 
of their ability to acquire an equivalent 
amount of the rudiments of reading and 
arithmetic, the four groups may be con- 
sidered roughly equal. An uncontrolled 
factor which certainly must have had 
some weight is that the four groups had 
varying amounts of exposure to the pub- 
lic school system when they were chil- 
dren. With this caveat in mind, it may 
be said that the ability to learn in 
school—and that is what the four groups 
here under scrutiny did—has frequently 
been used as a validating criterion in 
the construction of intelligence tests. 
Hence, it seems not too unfair to in- 
vestigate these two questions: (1) Does 
the possession of a common amount of 
literacy, even though that amount is 
rudimentary, insure that groups differ- 
ing in racial or linguistic composition 
will earn the same mean score on an ap- 
titude test; (2) what effect will the 
type of test employed have on the mean 
scores of the various groups? 


All English-speaking trainees enter- 
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AND THE TYPE OF TEST EMPLOYED 


By WILLIAM D. ALTUS 


UNIVERSITY OF CALIFORNIA, SANTA BARBARA COLLEGE 


ing the NSC Special Training Center 
were given four subtests of the Wech- 
sler Mental Ability Scale, Form B. These 
subtests were Information, Arithmetic, 
Comprehension and Similarities. All 
trainees who graduated from the Center 
were given the Army General Classifi- 
cation Test (AGCT) and, for most of 
the time the Center operated, the Me- 
chanical Aptitude Test (MAT) as well. 
The mean scores for the four groups 
here considered are given in Table I. 
On the four verbal subtests of the Wech- 
sler, the White and Negro means are 
practically synonymous; both groups 


TABLE I 


COMPARATIVE DATA ON TRAINEE GRADUATES 
FOR ONE INDIVIDUAL AND TWo 
Group TESTs 


Negro Mexican* Indian 
15.01 
62.96 
68.58 

375 
-280 
121** 


20.33 

66.90 

70.40 
-356 
-320 


Mean Wechsler ........... 23.41 23.34 
Mean AGCT . 68.15 65.75 
meee MAT un... TEE 68.70 
r of Wechsler-AGCT.... .298 285 
rf of Wechsler-MAT.... -222 .256 


Number of cases.......... 225 256 225 








*Bilingual Americans of Mexican ancestry. 
**For the correlation of Wechsler-MAT only 100 cases 
used. 


have mean scores which are significant- 
ly superior (.001 level of confidence) to 
those of the Mexican and of the Indian. 
Likewise, the mean Wechsler score of 
the Mexican is significantly superior to 
that of the Indian, again at the .001 lev- 
el of confidence. It would seem there- 
fore, that the acquisition of a constant 
amount of literacy does not imply a con- 
stant mean score on an individually ad- 
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ministered test of verbal aptitude if the 
racial or linguistic composition of the 
groups differs. The Negro does not ap- 
pear to suffer in this instance but the 
two bilingual groups, the Indian and the 
Mexican, certainly do; and of these lat- 
ter, the Indian suffers the greatest in- 
justice. 

The administration of the AGCT, a 
group test of general aptitude, consist- 
ing of vocabulary, arithmetical reason- 
ing and block counting, does not make 
the four groups any more alike in mean 
test score than they were on the Wech- 
sler. The Negro, who is approximately 
equal to the White in terms of Wech- 
sler means,. is significantly inferior to 
the White group on the AGCT (.01 lev- 
el of confidence). The Mexican, who is 
significantly inferior to the Negro on 
the Wechsler, is superior in mean score 
on the AGCT and there are nine chances 
in ten that the mean differences do not 
arise from chance factors. The Indian 
mean AGCT score is significantly inferi- 
or (.001 level of confidence) to the means 
of the three other groups. On the AGCT, 
as on the Wechsler, the Indian suffers 
the greatest relative deficit. 

The data from the Mechanical Apti- 
tude Test are next considered. For all 
the writer knows, the MAT may have 
been what its name implies, a test of 
“mechanical aptitude”. However, for the 
full gamut of ability acceptable to the 
Army, there was an overlap of 60 to 
80% in terms of factors common to the 
MAT and AGCT--and the latter test is 
considered to be a general aptitude test. 
For the bulk of soldiers tested in the 
Army, the MAT was probably almost 
as much a measure of general aptitude 
as was the AGCT. For this reason the 
means of the four groups were calcu- 
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lated for the MAT to see whether the 
same kind of differences would appear 
as were found on the Wechsler and 
AGCT. It will be noted that the White 
group maintains a superiority on the 
MAT as striking as it does on the AGCT. 
The mean differences in the scores of 
the Whites and the other three groups 
are all significant at the .001 level of 
confidence. The Mexican, who is signifi- 
cantly inferior to the Negro on the Wech- 
sler, somewhat superior (but not sig- 
nificantly so) to the Negro on the AGCT, 
has a superiority in mean score on the 
MAT, compared with the Negro, signifi- 
cant at the .05 level. The mean scores of 
the Indian and the Negro on the MAT 
are practically the same, 68.58 and 
68.70, respectively. 

The data thus seem to imply that 
group inferiority or superiority is in 
part, at least, a function of the test em- 
ployed. The most noticeable shifting oc- 
curs in the means of the Mexican and 
Negro trainees on the three tests. The 
mean Wechsler score of the Negro is 
significantly higher than that of the 
Mexican; the Mexican’s score on the 
AGCT is higher, though not significant- 
ly; finally, on the MAT, the superiority 
of the Mexican’s mean, compared with 
that of the Negro, reaches the .05 level 
of significance. Compared with the In- 
dian, the Negro has significantly higher 
scores on the Wechsler and the AGCT; 
on the MAT their scores are practically 
equal. Broadly, therefore, one may as- 
sume that certain group differences in 
intelligence reported in previous re- 
search for national, linguistic or racial 
groups might, on occasion, be completely 
contradicted if the type of measure were 
changed. 
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Books 


ADKINS, DoroTHY C. Construction and andaly- 
sis of achievement tests. Washington: U. S. 
Government Printing Office, 1947. Pp. xvii 
+292. $1.25 


Originally writen as a basis for training 
personnel of the U. S. Civil Service Com- 
mission, this government publication developed 
into a comprehensive text on achievement test- 
ing. In exceptionally readable style, it covers 
the problems of planning a test, writing items, 
and analyzing the test results. There is an 
excellent chapter on the elementary statistical 
techniques needed for test analysis, and one 
devoted to the special problems of the develop- 
ment of performance tests. This manual will 
be widely useful, as a reference for those who 
construct tests, and as a textbook for students. 


BEDELL, RALPH C. (Ed.) Basic guidance, sug- 
gestions for Nebraska schools. Lincoln, 
Nebr.: State of Nebraska, Department of 
Vocational Education, 1947. Pp. 70. $1.00. 


This publication is No. 1 of a series of 
Nebraska Guidance Bulletins, intended to as- 
sist the principals and teachers of small 
middle-western schools in the application of 
concepts and techniques of guidance. The at- 
tractively printed and illustrated booklet de- 
scribes in nontechnical language the purposes, 
methods, organization and evaluation of guid- 
ance activities in small schools. 


BURTON, ARTHUR, and HARRIS, ROBERT E. Case 
histories in clinical and abnormal psychol- 
ogy. New York: Harper, 1947. Pp. xii +4 
680. $4.00. 


There is a gulf between this volume and pre- 
vious “case books” that gave sketchy para- 
graphs to illustrate classic syndromes. Forty- 
five cases are described, with an average of 
15 pages devoted to each, so that space is 
available for a wealth of case history, psycho- 
metric, psychiatric and dynamic detail. The 
contributing authors are specialists, and pre- 
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sent the entire gamut of the phenomena stud- 
ied by clinical psychologists, from spastic 
paralysis to reading disability, from schizo- 
phrenia to simple malajustment. Frequent ci- 
tation of detailed test results, as on the Wech- 
sler, Rorschach and TAT, adds greatly to the 
instructional value of the cases. No book can 
replace clinical experience, but this one will 
be widely used as an introduction and as a 
supplement to first-hand contact with patients. 


COOKE, MARY. Opportunities for psychologists, 
psychiatrists, psychiatric social workers. 
An occupational brief. Pasadena, Calif.: 
Western Personnel Institute, 30 N. Raymond 
Ave., 1948. Pp. 38. $1.00. 


One of a series of occupational briefs this 
pamphlet gives considerable information on oc- 
cupations, opportunities, standards, and train- 
ing in the three related professions. The treat- 
ment is remarkably up-to-date, including the 
current work of the American Board of Ex- 
aminers, the VA training programs, and the 
Committee on Training in Clinical Psychology. 
Annotated references to almost all recent and 
pertinent articles are incorporated in the text. 
The style is interesting and easy, but contains 
no discovered misstatements. The pamphlet 
will be of great value for the orientation of 
prospective students. 


CuBER, JOHN F. Marriage counseling practice. 
New York: Appleton-Century-Crofts, 1948. 
Pp. xi 175. $2.25. 


As one of the few general surveys of its 
field, this book is intended as an orientation 
for beginning professional students and as a 
source of information for the lay reader. Mar- 
riage counseling is conceived as a therapeutic 
process, involving catharsis, giving informa- 
tion, interpreting, and aiding the client to 
face reality and make decisions. There is an 
inkling of the emergence of the marriage 
counselor as a real therapist, client-centered 
rather than wholly culture-centered. In a 
chapter on the preparation of marriage coun- 
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selors, the importance of training in psychia- 
try, law and religion, as well as in psychology 
and sociology, is stressed. Current professional 
needs are cited for public education, for the 
establishment of professional curricula, and 
for research. 


HALSTEAD, WARD C. Brain and intelligence, a 
quantitative study of the frontal lobes. 
Chicago: Univ. of Chicago Press, 1947. Pp. 
xiii + 206. $6.00 


Over a period of twelve years, 1935 to 1947, 
Halstead gave a special battery of tests to 
50 cases of cerebral lobectomy, of which 28 
were frontal, and to 187 other experimental 
and control subjects. A “blind” factor analysis 
of 13 tests, administered to a group of 50 
subjects recovered from brain injury, led to 
4 factors named as a “central integrative field” 
factor, an “abstraction” factor, a “power” 
factor, and a “directional” factor. An impair- 
ment index based on 10 tests differentiated 
completely between frontal lobectomies and a 
normal group, with nonfrontal lobectomies 
lying between. The effect of experimental an- 
oxia on the test scores is reported. Clinical 
psychologists will view Halstead’s research 
with mixed feelings. Its undeniable virtues lie 
in the long-continued work on one problem, in 
the experimental precision of the testing pro- 
cedures, and in the close coordination of psy- 
chological and neurological study. Important 
findings challenge long-held assumptions based 
largely on animal] experiments—Halstead, con- 
trary to Lashley, finds that impairment is de- 
termined by the place (frontal lobes) rather 
than by the amount of the brain lesion. The 
studies also have serious shortcomings. The 
value of the “factors” may be questioned for 
reason of the selection of the component tests, 
the group of subjects employed, and the 
“blind” statistical analysis. The sweeping 
claims of the identification of “biological” in- 
telligence as distinct from “psychometric” in- 
telligence are hardly supported by the evi- 
dence. The correlations of psychoanalytic and 
experimental concepts (the “factor of abstrac- 
ae is the fundamental growth prin- 
ciple of the ego.”) seem to arise more from 
the author’s aims than from his findings. It is 
easier, however, to criticize a pioneer study 
than to carry out a better one. Brain and In- 
telligence raises enough challenging questions 
to stimulate another generation of research 
work on the interrelations between experi- 
mental, clinical and physiological psychology. 


HAMILTON, GORDON. Psychotherapy in child 
guidance. New York: Columbia Univ. Press, 
1947. Pp. xxii + 340. $4.00. 


This is a study based on the practice of the 
Jewish Board of Guardians, which has been 
notable for its integration of a psychothera- 
peutic approach with social casework. The 
Board’s philosphy sees no distinction between 
the therapeutic situation and the child’s en- 
vironmental or reality situation—‘“all direct 
therapy being oriented fully to the social] situ- 
ation, and the whole social treatment being 
clinically oriented.” The social caseworker, in 
this philosophy, becomes the center of treat- 
ment. The psychiatrist and psychologist con- 
tribute mainly to the diagnostic phases, the 
psychiatrist continuing as a consultant in the 
therapeutic process. Techniques of treatment 
vary according to the diagnosis, especially be- 
tween the child with primary behavior dis- 
order who acts out his impulses, and the 
psychoneurotic child whose conflict is interna- 
lized. The basically psychoanalytic concepts of 
therapy are modified by interaction with the 
socia] orientation. The book is rich in insights 
into personality, and illustrations of thera- 
peutic methods. 


HAMRIN, S. A. Guidance talks to teachers. 
Bloominton, Ill.: McKnight & McKnight, 
1947. Pp. 249. 


A series of ten nontechnical talks on guid- 
ance, of which “The ten commandments of 
mental hygiene,” and “Measuring—rather 
than guessing,” are typical titles. Appendices 
include case studies, check lists, and materials 
on community surveys. 


KATz, DAvip. Psychological atlas. New York: 
Philosophical Library, 1948. Pp. x + 142. 
$5.00. 


Professor Katz of the University of Stock 
holm has assembled 395 pictures and dia- 
grams, mainly of European origin, that illus- 
trate a wide variety of topics in psychology. 
The range of subjects includes neurological 
charts, visual illusions, apparatus for various 
experiments (much of it amusingly antique), 
morphological types, children’s and psychot- 
ics’ drawings, vocational tests, and “occult” 
phenomena. Many of the pictures are familiar 
and others are trivial, but each reader will 
find a number of interest. Clinical psycholo 
gists may gain some satisfaction from the 
plates concerning abnormalities and from 
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those on tests, which includes the little-seen 
Szondi test. On the whole, however, the gain 
seems hardly to justify the price. 


KINSEY, ALFRED C., POMEROY, WARDELL B., 
AND MARTIN, CLYDE E. Sexual behavior in 
the human male. Philadelphia: Saunders, 
1948. Pp. xv + 804. $6.50. 


It seems that almost everyone, lay as well 
as professional, has read the “Kinsey report.” 
So widely circulated a study deserves careful- 
ly critical evaluation. Faults may be found in 
its method of interrogration, its sampling and 
its logic; these will be left to other reviewers. 
This JOURNAL will limit its brief comments to 
the significance for the clinical psychologist 
and counselor. The normative material of the 
research seems to have some use in the sim- 
pler aspects of counseling, in which the reas- 
surance of the data may overcome minor cul- 
turally-established inhibitions and worries. In 
psychotherapy, however, the chief concern is 
not with the “facts” of the client’s sex life, 
but with his attitudes toward them. Anxie- 
ties cannot be relieved by quoting statistics 
any more than by any other form of lectur- 
ing. The greatest influence may be on the at- 
titudes of clinical psychologists themselves. 
Even quite recent texts tuck glib paragraphs 
about homosexuality, stayriasis and zoophilia 
in the chapter on “psychopathic personality.” 
Kinsey identifies these “scientific” terms as 
mere reflections of evaluative cultural stand- 
ards. By revealing the wide variations among 
and within social groups in our culture, the 
study supplies broader norms, replacing those 
that the clinician formerly drew only from 
his own experience or from a limited social 
stratum. These data may help us to accept 
clients as they are, and to understand them, 
instead of to label their supposed abnormali- 
ties. 
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MorGAN, JOHN J. B. and LOVELL, GeorGe D. 
The psychology of abnormal people. (3rd 
Ed.) New York: Longmans Green, 1948. Pp. 
xi + 673. $4.50 


Morgan’s conservative but teachable book 
retains the essential features of the previous 
editions, but has been revised to incorporate 
new findings and techniques. Among the text’s 
assets are the catholic approach, the clear 
writing, the generous use of headings to ori- 
ent the student, and the extensive and newly 
revised bibliographies. Experimental material 
is given greater emphasis in this edition, and 
a good chapter on methods of treatment is al- 
most wholly new. A liability continues to be 
the largly compartmented organization. The 
separate chapters on disorders of intelligence, 
sensation, ete., are not adequately offset by 
the preceding two chapters of more holistic 
material. Psychologists will not learn much 
from this book, but their students will. 


WRENN, C. GILBERT. Building self-confidence. 
Stanford, Calif.: Stanford Univ. Press, 
1948. Pp. 29. 35¢. 


Designed for bibliotherapy of young people 
who lack self-confidence, this pamphlet intends 


to give insight through the use of illustrations, 
and to make suggestions for personal improve- 
ment. Topics include believing in yourself, 
overcoming feelings of inferiority, getting 
along with others, and determining what is 
right. The material may be used individually 
in connection with counseling, or with orien- 
tation and personal development classes in 
high schools, colleges, or other youth groups. 


TESTS 


No new tests were received by this Journal 
for review, in the period from January 15, to 
March 15, 1948. 


The publisher of the Apti- 


tude Test for Elementary School Teachers-in- 
Training, by H. Bowers (Normal School, 
Stratford, Ont.) should have been cited as: 
J. M. Dent & Sons (Canada) Ltd., Toronto, 
Ont., Canada. (J. consult. Psychol., 1948, 12, 
62.) 
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| 6, Timely Importance 





ABNORMAL PSYCHOLOGY 
By James D. Pace, Temple University. McGraw-Hill Pub- 
lications in Psychology. 450 pages, $4.00. 


A well-balanced text dealing with personality misfits in society, de- 
signed for students with a limited background in psychology. The 
book summarizes present knowledge concerning the causes, symp- 
toms, treatment, and outcome of psychoneuroses, psychoses, mental 
deficiencies, and anti-social personalities. Among outstanding features 


are the 13-page glossary and the list of visual aids—motion pictures 
and filmstrips--correlated with the material in the text. 


THE COMMONSENSE 
PSYCHIATRY OF ADOLF MEYER 


Fifty-two Selected , Edited with Biogeeghien! Is Marte 
tive Alfred Lief. juxe edition $12. 


fore July 30th. $14.00 thereafter. Regular ndition "¢t $0.60. 


The basic writings of a n who helped to shape the course of 
American psychiatry, cf ye first-hand teaching is now presented 
for the first time in book form. Working closely with Dr. Meyer, the 
author has assembled his addresses, journal articles, and reports, and 
linked them together with an account of the doctor’s life and work 
which points up tke evolution of his thought. The book traces the 
development of the commonsense approach to the problems of psy- 
chiatry, which deals with the whole organism in relation to daily life. 


MODERN CLINICAL PSYCHOLOGY 
By T. W. RicHarps, Antioch College: Chairman of Psy- 
chology, Fels Research Institute. McGraw-Hill Publica- 
tions in Psychology. 331 pages, $3.50 


An introduction to the general field of clinical psychology. Integrates 
material from various fields, such as abnormal psychology and psy- 
chiatry, modern testing procedures, current Sia lg princi- 
ples regarding the nature of personality and adjustment, will supple- 
men case m: Qne of the book’s ~ unusual features is 
that is ted in such a way that the student may 
see principles ilugtrated in the performance of patients with psycho- 
logical test materials. is a list of visual aids—motion pictures 
and a es with the material in the text. 
Send for a copy on approval 


McGRAI V-HILL BOOK CO. INC. 
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=—recent and established texts — 


THE PSYCHOLOGY OF BEHAVIOR DISORDERS 
Norman Cameron, Chairman of the Department of Psychology, University of Wisconsin. 


The Psychology of Rehavior Disorders is an original contribution —a systematic 
ing of the whole field of neurotic and psychotic behavior from a consist- 
ently biosocial point of view. 


COUNSELING AND PSYCHOTHERAPY 
Carl R. Rogers, Professor of Psychology, University of Chicago. 


Dr. Rogers emphasizes a non-directive approach to counseling and psychother- 
apy—an approach whose purpose is to release more effectively the individual’s 
potentialities for growth. 


CASEBOOK OF NON-DIRECTIVE COUNSELING 


Edited by William U. Snyder, Assistant Professor, of Psychology and Associate Director of the 
Psycho-Educational Clinic, Pennsylvania State College. With the collaboration of Carl R. Rogers, 
George A. Muench, Arthur W. Combs, end Virginia Mae Axtine. 


A collection of five cases of psychological problems treated by the technique of 
nen-directive counseling. The cases are edited so that they instruct the student 
in specific techniques. 


PLAY THERAPY 
Virginia Mae Axline, Department of Psychology, University of Chicago. 


Miss Axline’s book tells how, through skillfully conducted play therapy and group 
therapy, warped and maladjusted youngsters find the capacity to work out a con- 
structive adjustment to life. 


PROBLEMS OF CHILD DELINQUENCY 
Mand A. Merrill, Professor of Psychology, Stanford University. 


Dr. Merrill has had wide practical experience in juvenile court work and her 
book deals Roe wag with the problems of child delinquency from a psy- 
chological standpoint. It brings together many tcsted techniques and evaluates 
many previous studies. Many individual case studies are ineluded. 


THE CLINICAL TREATMENT OF THE PROBLEM CHILD 
Carl R. Rogers, Professor of Psychology, University of Chicago. 


This book deals in an authoritative, modern way with the practical measures 
which may be used to rehabilitate the problem child: changing the environment; 
modifying the environment; and dealing with the individual. 


HOUGHTON MIFFLIN COMPANY 
Boston New York Chicago Dallas San Francisco 
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